-- Logs begin at Wed 2022-08-31 18:25:31 UTC, end at Wed 2022-08-31 20:27:30 UTC. -- Aug 31 19:16:04.430372 dv-cinder-852209-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 19:16:04.439086 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:16:04 2022] *** Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: nodename: dv-cinder-852209-9-iscsi Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: machine: x86_64 Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: clock source: unix Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: pcre jit disabled Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: detected number of CPU cores: 4 Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: current working directory: / Aug 31 19:16:04.440963 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: your processes number limit is 47680 Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: your memory page size is 4096 bytes Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: detected max file descriptor number: 2048 Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: lock engine: pthread robust mutexes Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: thunder lock: enabled Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 19:16:04.441726 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:16:04.479787 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: Python main interpreter initialized at 0x55f3254af9c0 Aug 31 19:16:04.479787 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: python threads support enabled Aug 31 19:16:04.479787 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: your server socket listen backlog is limited to 100 connections Aug 31 19:16:04.479787 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:16:04.480144 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:16:04.480222 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: *** Operational MODE: preforking *** Aug 31 19:16:04.480467 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:16:04.480467 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: spawned uWSGI master process (pid: 106154) Aug 31 19:16:04.480673 dv-cinder-852209-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 19:16:04.481219 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: spawned uWSGI worker 1 (pid: 106155, cores: 1) Aug 31 19:16:04.481547 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: spawned uWSGI worker 2 (pid: 106156, cores: 1) Aug 31 19:16:04.481711 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:16:05.142986 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:16:05.144144 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:16:06.236799 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:06.236799 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: from cryptography.utils import int_from_bytes Aug 31 19:16:06.237500 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:06.237500 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: from cryptography.utils import int_from_bytes Aug 31 19:16:06.237906 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:06.237906 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: from cryptography.utils import int_from_bytes Aug 31 19:16:06.238047 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:16:06.238047 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: from cryptography.utils import int_from_bytes Aug 31 19:16:08.726700 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:16:08.727409 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:16:08.727768 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:16:08.727863 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:16:08.727945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:16:08.728014 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:16:08.728086 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:16:08.728155 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:16:08.728221 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:16:08.728288 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:16:08.728469 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.728566 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.728774 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.728862 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.729095 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.729189 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.729413 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.729504 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.729740 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.729825 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.730049 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.730147 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.730364 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.730459 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.730679 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.730784 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731021 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731124 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731278 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731367 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731597 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731747 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.731904 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-9-iscsi {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.732004 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-9-iscsi {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.732220 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.732587 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.732789 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.732904 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.733097 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.733193 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.733407 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.733501 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.733705 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.733802 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.734021 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.734109 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.734319 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.734407 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.734816 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.734952 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.735264 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.735388 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.735565 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.735679 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.735869 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.735992 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.736207 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.736396 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.736509 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.736601 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.736814 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.736908 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.737134 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.737222 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.737435 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.737529 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.737753 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.737845 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.738056 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.738149 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.738448 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-9-iscsi {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.738536 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-9-iscsi {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.738756 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.738844 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.739089 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.739165 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.739931 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.740089 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.740530 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.740707 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.740820 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.740891 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741047 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741135 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741470 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741613 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741713 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741850 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.741974 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.742082 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.742290 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.742448 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.742606 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.742731 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.742989 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743120 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743272 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743395 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743573 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743705 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743882 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.743971 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.744189 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.744276 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.744505 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.744600 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.744809 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.744989 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.745183 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.745337 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.745428 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.745588 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.745677 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.745921 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.746023 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.746264 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.746470 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.746588 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.746838 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.746945 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.747114 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.747278 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.747431 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.747520 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.747753 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.747853 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748059 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748155 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748364 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748452 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748668 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748762 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.748972 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749071 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749273 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749367 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749573 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749708 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749875 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.749975 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.750178 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.750275 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.750473 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.750584 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.750776 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.750909 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.751118 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.751237 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.751424 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.751522 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.751741 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.751837 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.752079 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.752174 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.752370 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.752467 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.752680 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.752776 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753007 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753100 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753370 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753483 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753667 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753765 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.753917 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.754004 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.754233 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.754321 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.754538 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.754633 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.754842 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755032 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755275 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755427 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755585 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755734 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755885 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.755986 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.756164 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.756262 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.756484 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.756578 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.756781 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.756875 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757028 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757124 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757325 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757413 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757664 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757751 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.757975 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.758070 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.758275 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.758396 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.759112 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.759235 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.759423 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.759730 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.759817 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.760035 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.760247 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.760341 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.760630 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.760816 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.760943 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.761225 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.761387 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.761527 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.761884 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.761987 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.762160 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.762451 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.762539 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.762756 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.763082 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.763175 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.763386 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.763657 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.763755 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.764235 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.764334 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.764583 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.764758 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.764899 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.765202 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.765297 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.765504 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.765712 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.765804 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.766071 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.766158 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.766392 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.766481 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.766702 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.766788 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767023 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767129 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767329 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767428 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767643 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767732 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.767952 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768039 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768254 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768350 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768555 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768643 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768855 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.768951 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.769156 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.769244 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.769457 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.769553 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.769755 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.769851 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.770054 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.770141 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.770349 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.770437 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.770696 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.770823 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771051 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771158 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771362 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771460 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771668 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771781 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.771970 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.772061 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.772280 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.772387 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.772578 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.772675 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.772880 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.772968 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.773182 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.773276 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.773484 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.773631 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.773775 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.773863 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.774067 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.774184 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.774418 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.774558 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.774734 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.774822 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.775066 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.775154 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.775373 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.775462 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.775676 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.775764 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.775992 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:16:08.776089 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.776315 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.776400 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.776630 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.776718 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.776947 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777043 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777261 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777346 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777574 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777669 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777892 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.777988 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.778209 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.778297 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.778514 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.778613 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.778825 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.778966 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.779173 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.779263 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.779478 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.779566 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.779784 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.779880 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.780092 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.780180 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.780405 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.780493 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.780719 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.780815 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781044 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781158 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781351 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781441 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781659 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781748 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.781966 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.782053 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.782271 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.782401 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.782585 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.782675 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.782929 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783035 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783249 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783341 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783555 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783693 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783890 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.783986 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.784231 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.784319 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.784541 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.784639 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.784851 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.784948 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.785163 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.785263 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.785466 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.785552 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.785770 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.785858 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.786074 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.786171 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.786418 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.786578 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.786752 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.786959 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.787102 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.787210 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.787388 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.787479 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.787703 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.787791 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788021 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788190 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788329 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788418 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788636 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788732 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.788943 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789044 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789248 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789345 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789551 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789647 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789860 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.789949 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.790162 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.790250 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.790476 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.790570 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.790787 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.790906 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.791115 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.791214 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.791429 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.791518 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.791736 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.791823 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792039 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792133 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792343 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792473 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792642 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792736 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.792941 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793035 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793238 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793333 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793542 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793632 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793841 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.793927 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.794152 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.794251 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.794458 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.794553 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.794760 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.794854 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.795105 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.795211 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.795404 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.795491 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.795706 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.795802 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796008 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796104 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796313 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796401 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796658 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796745 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.796967 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797055 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797272 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797361 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797577 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797673 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797891 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.797979 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.798193 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.798280 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.798493 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.798580 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.798811 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.798941 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.799138 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.799238 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.799442 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.799537 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.799751 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.799840 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800056 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800144 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800358 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800453 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800664 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800752 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.800963 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.801050 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.801300 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.801398 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.801603 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.801691 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.802433 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.802565 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.802741 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.802940 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.803189 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.803281 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.803491 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.803592 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.803812 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.803965 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.804121 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.804216 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.804431 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.804518 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.804731 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.804820 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805033 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805120 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805330 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805416 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805631 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805720 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.805928 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806016 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806231 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806318 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806529 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806625 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806828 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.806936 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.807151 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.807252 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.807450 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.807540 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.807748 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.807836 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.808070 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.808168 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.808374 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.808462 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.808672 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.808841 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809307 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809427 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809511 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809591 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809670 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809750 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.809887 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.810066 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.810222 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.810388 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.810552 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.810697 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.810922 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811033 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811215 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811340 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811596 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811701 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811843 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.811933 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.812150 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.812239 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.812459 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.812554 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.812772 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.812890 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.813081 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.813209 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.813449 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.813537 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.813763 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.813852 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.814081 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.814169 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.814389 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.814479 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.814710 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.814800 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815042 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815130 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815355 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815443 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815655 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815744 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.815966 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.816062 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.816282 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.816377 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.816592 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.816696 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.816914 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.817012 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.817215 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.817377 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.817541 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.818135 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.818400 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.818559 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.818766 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.818969 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.819190 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.819279 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.819503 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.819593 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.819814 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.819920 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.820138 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.820226 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.820460 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.820556 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.820771 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.820862 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821162 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821383 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821469 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821691 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821812 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.821997 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.822097 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.822300 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.822399 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.822606 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.822695 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.822933 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823038 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823249 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823345 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823554 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823643 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823861 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.823949 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.824165 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.824261 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.824467 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.824556 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.824767 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.824854 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825071 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825172 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825370 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825466 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825669 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825766 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.825973 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.826118 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.826297 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.826385 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.826600 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.826688 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.826918 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.827023 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.827243 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.827332 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.827552 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.827692 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828104 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828211 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828294 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828385 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828468 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828554 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828739 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.828857 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829056 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829166 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829362 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829458 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829678 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829767 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.829993 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.830081 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.830355 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.830455 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.830659 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.830749 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.830987 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831078 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831296 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831395 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831596 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831692 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831898 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.831998 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.832194 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.832292 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.832499 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.832595 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.832809 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.832898 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.833134 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.833304 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.833474 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.833619 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.833798 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.833954 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.834101 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.834236 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.834412 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.834551 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.834723 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.834820 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.835050 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.835154 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.835360 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.835471 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.835676 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.835765 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.836071 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.836252 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.836376 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.836589 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.836676 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.836907 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837004 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837226 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837314 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837546 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837635 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837885 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.837987 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.838210 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.838297 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.838523 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.838619 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.838822 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.838966 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.839165 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.839254 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.839477 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.839565 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.839781 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840078 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840179 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840386 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840473 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840691 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840787 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.840998 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.841088 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.841300 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.841388 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.841607 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.841698 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.841917 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842065 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842313 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842495 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842589 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842802 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.842927 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.843143 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.843231 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.843478 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.843565 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.843780 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.843876 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844087 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844178 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844386 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844474 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844685 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844782 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.844984 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845081 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845299 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845385 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845601 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845698 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845900 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.845987 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.846202 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.846290 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.846501 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.846597 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.846810 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.846937 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.847162 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.847250 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.847471 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.847561 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.847804 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.847891 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.848127 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.848215 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.848433 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.848521 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.848751 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.848845 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849076 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849242 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849413 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849574 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849699 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849865 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.849999 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.850172 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.850331 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.850485 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.850654 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.850797 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851015 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851138 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851317 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851448 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851615 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851751 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.851934 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852061 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852234 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852362 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852531 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852677 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852828 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.852984 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.853340 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.853435 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.853505 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.853584 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.853743 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.853873 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854048 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854181 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854354 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854483 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854660 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854792 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.854988 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.855120 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.855288 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.855436 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.855592 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.855740 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.855888 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856042 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856195 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856347 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856499 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856652 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856796 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.856960 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.857094 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.857260 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.857661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.857845 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.857964 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.858155 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.858250 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.858459 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.858549 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.858765 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.858852 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.859194 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.859295 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.859466 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.859557 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.859764 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.859938 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860124 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860235 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860363 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860460 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860667 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860765 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.860964 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861062 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861282 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861371 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861589 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861676 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861889 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.861985 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.862186 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.862273 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.862487 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.862575 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.862784 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.862902 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.863106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.863202 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.863406 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.863492 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.863709 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.863799 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.864010 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.864097 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.864305 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.864927 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.865151 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.865313 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.865463 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.865616 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.865730 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.865842 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866020 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866166 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866321 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866494 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866799 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.866950 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.867182 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.867284 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.867490 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.867578 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.867795 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.867883 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.868109 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.868197 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.868411 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.868505 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.868715 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.868805 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869016 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869111 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869315 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869410 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869627 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869715 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.869939 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870025 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870249 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870335 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870554 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870643 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870858 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.870965 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.871198 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.871303 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.871510 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.871608 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.871821 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.871916 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.872135 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.872230 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.872439 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.872531 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.872751 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.872838 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873110 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873209 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873344 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873435 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873645 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873731 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.873969 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.874077 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.874248 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.874337 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.874555 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.874643 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.874862 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875016 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875198 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875294 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875509 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875596 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875818 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.875908 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.876117 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.876203 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.876422 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.876508 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.876727 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.876815 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877032 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877126 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877334 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877428 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877639 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877736 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.877946 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.878032 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.878246 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.878334 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.878551 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.878637 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.878849 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879019 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879184 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879283 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879485 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879581 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879790 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.879908 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.880700 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.880854 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.881007 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.881171 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.881400 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.881491 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.881710 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.881808 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882010 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882098 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882317 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882448 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.882945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.883036 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.883247 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.883368 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.883674 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.883764 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.883983 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884070 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884289 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884375 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884590 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884678 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884891 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.884979 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.885196 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.885322 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.885512 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.885602 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.885814 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.885902 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.886112 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.886207 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.886413 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.886524 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.886734 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.886822 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.887062 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.887209 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.887384 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.887473 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.887748 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.887835 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888046 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888144 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888352 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888440 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888674 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888783 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.888973 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.889098 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.889272 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.889405 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.889570 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.889725 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.889888 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.890045 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.890186 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.890445 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.890539 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.890754 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.890931 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.891092 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.891237 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.891403 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.891535 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.891724 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.891945 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892040 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892251 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892341 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892557 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892645 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892874 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.892961 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.893191 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.893281 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.893509 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.893604 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.893811 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.893905 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.894119 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.894209 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.894424 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.894513 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.894742 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.894837 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.895086 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.895176 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.895392 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.895470 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.895774 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.895971 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896190 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896366 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896455 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896673 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896781 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.896977 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897066 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897280 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897377 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897600 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897697 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897900 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.897988 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.898208 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.898296 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.898517 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.898615 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.898822 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.898957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.899153 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.899260 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.899454 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.899551 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.899773 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.899861 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900072 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900170 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900372 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900461 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900769 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.900980 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901068 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901287 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901383 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901593 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901680 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.901980 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.902191 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.902280 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.902489 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.902575 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.902789 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.902907 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.903116 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.903214 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.903431 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.903520 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.903739 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.903841 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904054 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904150 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904365 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904459 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904663 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904761 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.904981 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.905069 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.905284 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.905371 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.905581 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.905681 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.905878 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.906050 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.906175 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.906373 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.906511 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.906698 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.906809 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907024 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907152 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907329 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907478 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907638 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907803 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.907941 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.908108 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.908245 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.908436 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.908547 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.908762 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.908851 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.909077 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.909173 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.909391 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.909480 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.909711 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.909814 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910011 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910107 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910308 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910398 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910613 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910701 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.910934 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.911074 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.911254 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.911446 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.911602 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.911753 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.911897 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912017 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912130 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912234 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912427 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912524 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912726 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.912847 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913042 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913153 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913339 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913469 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913655 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913784 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.913957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.914100 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.914257 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.914416 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.914555 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.914729 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.914852 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915064 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915210 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915378 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915508 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915691 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915830 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.915999 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.916133 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.916314 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.916449 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.916626 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.916777 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.916943 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.917043 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.917356 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.917476 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.917662 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.917804 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.917971 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.918118 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.918297 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.918429 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.918580 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.918737 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.918890 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.919077 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.919213 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.919390 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.919521 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.919699 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.919832 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.920007 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.920315 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.920404 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.920621 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.920718 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.920945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.921042 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.921264 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.921353 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.921571 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.921658 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922222 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922341 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922434 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922517 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922598 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922686 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922768 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.922938 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.923103 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.923192 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.923495 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.923584 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.923830 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.923920 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.924132 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.924220 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.924444 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.924533 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.924758 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.924847 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925070 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925159 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925379 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925538 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925668 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925756 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.925983 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.926078 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.926289 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.926385 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.926598 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.926687 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.927469 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.927619 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.927768 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.927905 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.928086 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.928285 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.928402 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.928631 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.928730 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.928949 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929038 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929260 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929349 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929570 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929668 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929880 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.929977 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.930188 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.930453 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.930708 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.930799 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.931051 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.931143 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.931365 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.931454 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.931687 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.931777 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932018 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932116 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932331 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932417 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932638 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932726 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.932945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.933032 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.933250 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.933346 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.933560 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.933788 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.933888 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.934122 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.934226 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.934431 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.934521 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.934751 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.934847 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.935079 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.935171 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.935396 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.935494 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.935702 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.935797 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936026 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936232 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936330 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936579 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936671 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936893 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.936990 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.937203 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.937300 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.937508 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.937666 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.937816 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.937921 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.938113 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.938211 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.938412 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.938502 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.938725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.938813 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.939061 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.939153 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.939422 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.939588 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.939725 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.939931 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940031 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940241 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940331 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940561 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940657 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940878 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.940976 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.941185 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.941273 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.941484 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.941570 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.941782 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.941871 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.942085 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.942179 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.942382 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.942517 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.943285 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.943429 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.943581 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.943756 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.943896 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.943983 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.944173 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.944263 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.944473 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.944563 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.944777 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.944866 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945078 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945171 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945385 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945475 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945687 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945803 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.945992 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946070 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946291 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946387 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946588 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946685 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946903 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.946995 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.947214 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.947345 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.947513 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.947619 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.947813 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.947901 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.948114 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.948202 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.948435 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.948535 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.948740 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.948836 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949043 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949131 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949348 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949437 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949644 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949740 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.949951 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.950038 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.950276 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.950372 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.950579 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.950667 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.950943 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.951141 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.951264 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.951477 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.951573 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.951797 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.951887 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.952130 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.952227 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.952434 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.952522 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.952749 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.952838 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.953053 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.953144 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.953357 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.953446 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.953697 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.953794 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.954008 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.954105 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.954313 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.954533 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.954629 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.954863 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955025 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955201 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955298 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955525 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955613 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955832 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.955932 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.956139 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.956275 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.956438 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.956525 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.956739 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.956829 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957065 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957221 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957349 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957557 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957696 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957826 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.957956 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.958084 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.958295 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.958439 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.958599 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.958824 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.958940 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959024 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959229 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959339 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959534 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959622 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959838 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.959928 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.960144 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.960243 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.960447 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.960535 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.960747 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.960834 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961050 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961147 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961351 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961447 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961658 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961761 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.961972 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.962060 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.962278 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.962375 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.962601 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.962689 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.962932 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963026 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963248 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963340 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963554 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963642 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963857 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.963947 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.964163 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.964250 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.964468 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.964571 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.964783 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.964880 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.965108 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.965198 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.965420 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.965519 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.965719 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.965813 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.966062 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.966148 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.966386 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.966487 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.966709 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.966805 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967034 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967130 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967335 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967433 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967636 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967724 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.967942 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968062 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968257 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968347 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968562 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968651 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968862 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.968951 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.969168 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.969265 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.969470 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.969559 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.969770 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.969867 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970069 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970157 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970367 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970463 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970666 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970763 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.970989 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971092 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971287 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971388 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971586 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971695 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971881 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.971970 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.972184 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.972317 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.972478 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.972581 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.972777 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.972866 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973076 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973164 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973373 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973465 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973667 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973783 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.973995 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.974153 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.974320 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.974462 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.974564 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.974643 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.974853 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975024 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975171 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975301 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975463 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975612 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975761 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.975934 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.976060 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.976251 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.976351 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.976563 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.976648 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.976915 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977012 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977184 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977273 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977498 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977586 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977795 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.977893 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.978100 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.978188 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.978429 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.978518 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.978738 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.978857 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979153 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979382 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979472 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979689 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979778 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.979991 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.980080 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.980294 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.980390 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.980609 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.980705 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.980921 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981030 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981219 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981316 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981538 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981841 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.981928 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.982147 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.982244 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.982718 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.982811 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983048 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983138 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983353 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983443 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983657 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983745 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.983964 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984051 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984273 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984364 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984579 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984667 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984885 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.984973 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.985199 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.985294 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.985504 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.985591 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.985811 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.985912 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.986118 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.986207 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.986427 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.986577 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.986735 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.986833 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987068 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987159 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987373 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987461 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987679 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987824 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.987986 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.988083 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.988297 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.988386 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.988644 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.988745 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.988955 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.989056 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.989269 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.989877 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990132 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990282 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990445 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990612 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990716 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990823 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.990973 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:16:08.991158 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.991481 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.991804 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.992147 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.992456 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.992796 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.993122 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.993432 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.993742 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.994045 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:16:08.994285 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:16:09.147282 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO dbcounter [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Registered counter for database nova_api Aug 31 19:16:09.150430 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO dbcounter [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Registered counter for database nova_api Aug 31 19:16:09.168690 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_db.sqlalchemy.engines [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.170440 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_db.sqlalchemy.engines [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.175436 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writer thread running {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.177793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writer thread running {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.234717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.context [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3de6f35d-b6ae-4864-abed-e50e71414e62(cell1) {{(pid=106156) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:16:09.238177 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_concurrency.lockutils [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.238357 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.context [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3de6f35d-b6ae-4864-abed-e50e71414e62(cell1) {{(pid=106155) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:16:09.238645 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_concurrency.lockutils [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.240913 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_concurrency.lockutils [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.241642 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_concurrency.lockutils [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.242084 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_concurrency.lockutils [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.243042 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.243575 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.244121 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_concurrency.lockutils [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.245236 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.245946 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:16:09.246384 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:16:09.246592 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO dbcounter [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Registered counter for database nova_cell0 Aug 31 19:16:09.248407 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:16:09.250386 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO dbcounter [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Registered counter for database nova_cell0 Aug 31 19:16:09.250732 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO dbcounter [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Registered counter for database nova_cell1 Aug 31 19:16:09.254438 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO dbcounter [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Registered counter for database nova_cell1 Aug 31 19:16:09.259303 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_db.sqlalchemy.engines [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.261171 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_db.sqlalchemy.engines [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.263027 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_db.sqlalchemy.engines [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.264528 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_db.sqlalchemy.engines [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.266387 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writer thread running {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.271655 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writer thread running {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.276635 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writer thread running {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.422365 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO dbcounter [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Registered counter for database nova_cell0 Aug 31 19:16:09.433198 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_db.sqlalchemy.engines [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.437814 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writer thread running {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.453360 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writer thread running {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.466367 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO dbcounter [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Registered counter for database nova_cell0 Aug 31 19:16:09.478978 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG oslo_db.sqlalchemy.engines [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:16:09.484647 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writer thread running {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:16:09.880299 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: WARNING keystonemiddleware.auth_token [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:09.887946 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: WARNING keystonemiddleware.auth_token [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:10.017363 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: WARNING keystonemiddleware.auth_token [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:10.025879 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: WARNING keystonemiddleware.auth_token [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:10.231152 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: WARNING keystonemiddleware.auth_token [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:10.237687 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: WARNING keystonemiddleware.auth_token [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:10.243242 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3254af9c0 pid: 106155 (default app) Aug 31 19:16:10.245524 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:16:10.246858 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002028 Aug 31 19:16:10.247323 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Wed Aug 31 19:16:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:16:10.373487 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: WARNING keystonemiddleware.auth_token [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:16:10.379649 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: WARNING keystonemiddleware.auth_token [None req-18634eea-a3d2-4e28-a609-f6f0a12b14e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:16:10.385089 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f3254af9c0 pid: 106156 (default app) Aug 31 19:17:35.605361 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:35.607953 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004300 Aug 31 19:17:35.608990 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:35.632201 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writing DB stats nova_api:SELECT=3 {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:35.633882 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writing DB stats nova_cell1:SELECT=3 {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:35.635005 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writing DB stats nova_cell0:SELECT=3 {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:35.636209 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:36.569746 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5e8564fe-9db1-4a76-80a3-d5569ebc0e14 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:36.602304 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-5e8564fe-9db1-4a76-80a3-d5569ebc0e14 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.981448 Aug 31 19:17:36.603055 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 31 19:17:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:39.053682 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:39.054757 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-e662356b-f3b4-4ae4-ad46-8056db29d549 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001382 Aug 31 19:17:39.066816 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:39.515652 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-9cc8c6e7-5d4e-4e59-8fc4-a6ca562efb26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "swap": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:39.627587 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-9cc8c6e7-5d4e-4e59-8fc4-a6ca562efb26 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.566205 Aug 31 19:17:39.644039 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_api:SELECT=3 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:39.645506 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_cell1:SELECT=3 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:39.646310 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_cell0:SELECT=3 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:39.646900 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:17:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:17:39.647242 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:17:39.860058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-e7319b09-30d0-45e7-a84f-56564752a9c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:40.000390 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-e7319b09-30d0-45e7-a84f-56564752a9c5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.362118 Aug 31 19:17:40.000902 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 31 19:17:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:17:42.474264 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-9cc8c6e7-5d4e-4e59-8fc4-a6ca562efb26 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:42.475468 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-9cc8c6e7-5d4e-4e59-8fc4-a6ca562efb26 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 31 19:17:42.478995 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:43.239246 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-c8fee131-5c0b-44d7-ba58-a1b0088ae4b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "ram": 512, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:43.395720 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-c8fee131-5c0b-44d7-ba58-a1b0088ae4b3 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.912141 Aug 31 19:17:43.396289 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:17:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:17:43.408611 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-7fc7c2cd-950a-4e21-9fd7-1c3ee8fb7560 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:43.541511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-7fc7c2cd-950a-4e21-9fd7-1c3ee8fb7560 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136481 Aug 31 19:17:43.547039 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 31 19:17:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:45.975138 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-c8fee131-5c0b-44d7-ba58-a1b0088ae4b3 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:45.976098 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-c8fee131-5c0b-44d7-ba58-a1b0088ae4b3 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Aug 31 19:17:45.976500 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:46.395431 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-d019783a-95f3-4ad0-a740-7cb08bff9b2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "swap": 0, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:46.467465 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-d019783a-95f3-4ad0-a740-7cb08bff9b2b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484333 Aug 31 19:17:46.468127 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:17:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:17:46.480553 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-763fd2ab-abcf-4353-8caa-562a6014a4ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:46.557286 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-763fd2ab-abcf-4353-8caa-562a6014a4ba admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080325 Aug 31 19:17:46.557802 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 31 19:17:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:48.969877 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-d019783a-95f3-4ad0-a740-7cb08bff9b2b admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:48.970958 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-d019783a-95f3-4ad0-a740-7cb08bff9b2b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 31 19:17:48.971381 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:49.448218 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-210b6585-7184-4c53-9006-b1e603534c96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:49.760589 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-210b6585-7184-4c53-9006-b1e603534c96 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.776457 Aug 31 19:17:49.761130 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:17:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:17:49.774070 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b127f7b5-7401-4394-958c-dfd1382bad64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:49.922269 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b127f7b5-7401-4394-958c-dfd1382bad64 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.151900 Aug 31 19:17:49.923130 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 31 19:17:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:52.326531 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-210b6585-7184-4c53-9006-b1e603534c96 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:52.327561 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-210b6585-7184-4c53-9006-b1e603534c96 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 31 19:17:52.328140 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:52.774763 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-62435ec3-d6e9-4ce3-a727-48e77f10e92d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "vcpus": 4}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:52.868715 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-62435ec3-d6e9-4ce3-a727-48e77f10e92d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533763 Aug 31 19:17:52.869576 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:17:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:17:52.883408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-718b1159-5894-40fd-bb0a-a98768e5c35f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:52.991638 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-718b1159-5894-40fd-bb0a-a98768e5c35f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113358 Aug 31 19:17:52.992307 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 31 19:17:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:17:55.420059 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-62435ec3-d6e9-4ce3-a727-48e77f10e92d admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:55.421109 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-62435ec3-d6e9-4ce3-a727-48e77f10e92d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 31 19:17:55.421505 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:17:55.871636 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-2f632dda-2f08-49d7-92ea-73df434c75db admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:55.897298 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-2f632dda-2f08-49d7-92ea-73df434c75db admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468539 Aug 31 19:17:55.897778 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 31 19:17:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:17:58.353839 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-62435ec3-d6e9-4ce3-a727-48e77f10e92d admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:17:58.355017 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-62435ec3-d6e9-4ce3-a727-48e77f10e92d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 31 19:17:58.355491 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:17:58.779721 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-9ada613a-c9b2-4386-b621-69c9dcecef9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "ram": 512, "swap": 0, "id": "1"}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:58.862184 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-9ada613a-c9b2-4386-b621-69c9dcecef9a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.499588 Aug 31 19:17:58.863110 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:17:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:17:58.876423 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-a3aabd4f-3aa2-4c62-9636-25b3d0e53c24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:17:58.975484 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-a3aabd4f-3aa2-4c62-9636-25b3d0e53c24 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103531 Aug 31 19:17:58.976105 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 31 19:17:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:01.401411 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-9ada613a-c9b2-4386-b621-69c9dcecef9a admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:01.402685 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-9ada613a-c9b2-4386-b621-69c9dcecef9a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 31 19:18:01.402955 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:01.821038 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-2cb2570a-e2ea-43e4-b3b6-39fe9d32643b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:01.947324 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-2cb2570a-e2ea-43e4-b3b6-39fe9d32643b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.535973 Aug 31 19:18:01.947891 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:18:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:01.960695 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-7641cdac-4ee1-4dfa-b6a9-a6c4d1687546 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:02.043211 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-7641cdac-4ee1-4dfa-b6a9-a6c4d1687546 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086065 Aug 31 19:18:02.048302 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 31 19:18:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:04.474298 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-2cb2570a-e2ea-43e4-b3b6-39fe9d32643b admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:04.476112 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-2cb2570a-e2ea-43e4-b3b6-39fe9d32643b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002305 Aug 31 19:18:04.476710 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:04.936592 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-f5dfaf26-7039-4f4e-98c7-aa4dfb6602b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "ram": 4096, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:05.005025 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-f5dfaf26-7039-4f4e-98c7-aa4dfb6602b6 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.521472 Aug 31 19:18:05.005578 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:18:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:05.017554 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-18366a7b-a599-42d9-93c1-935101c406e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:05.100507 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-18366a7b-a599-42d9-93c1-935101c406e9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086528 Aug 31 19:18:05.101088 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 31 19:18:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:07.640200 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-f5dfaf26-7039-4f4e-98c7-aa4dfb6602b6 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:07.640200 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-f5dfaf26-7039-4f4e-98c7-aa4dfb6602b6 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 19:18:07.640200 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:08.122646 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-7dc22b6d-eaae-40c8-b7c6-265c53e634be admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:08.130677 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:08.428676 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-7dc22b6d-eaae-40c8-b7c6-265c53e634be admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.797436 Aug 31 19:18:08.429342 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:18:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:08.442460 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-9b957720-92d5-4fe7-8d0d-5b9a0a5bea17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:08.585998 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-9b957720-92d5-4fe7-8d0d-5b9a0a5bea17 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147857 Aug 31 19:18:08.586598 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 31 19:18:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:11.001198 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-7dc22b6d-eaae-40c8-b7c6-265c53e634be admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:11.006622 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-7dc22b6d-eaae-40c8-b7c6-265c53e634be admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Aug 31 19:18:11.006622 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:11.494476 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-499f89a8-68ae-484b-ae68-166c32173988 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:11.629511 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-499f89a8-68ae-484b-ae68-166c32173988 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.619719 Aug 31 19:18:11.630054 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 31 19:18:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:18:11.642470 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-c87f3c68-1046-416e-a861-e27b12e2d4fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:11.786692 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-c87f3c68-1046-416e-a861-e27b12e2d4fd admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148366 Aug 31 19:18:11.787707 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 31 19:18:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:18:31.465131 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-499f89a8-68ae-484b-ae68-166c32173988 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.466226 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-499f89a8-68ae-484b-ae68-166c32173988 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 31 19:18:31.466633 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:31.872831 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-63fcb66d-99d0-4511-9844-7c45465d0976 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:31.892938 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-63fcb66d-99d0-4511-9844-7c45465d0976 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.418878 Aug 31 19:18:31.893398 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 31 19:18:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:32.962816 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-499f89a8-68ae-484b-ae68-166c32173988 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:32.963869 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-499f89a8-68ae-484b-ae68-166c32173988 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 31 19:18:32.964257 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:33.508693 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-2f5df329-a03c-4da9-9fef-087dce7559a8 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.514263 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.wsgi [None req-2f5df329-a03c-4da9-9fef-087dce7559a8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-2f5df329-a03c-4da9-9fef-087dce7559a8 admin admin] Request method failure captured: Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Accept: application/json Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Accept-Encoding: gzip, deflate Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Connection: keep-alive Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Content-Length: 0 Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Host: 10.222.0.59 Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Openstack-Api-Version: compute 2.90 Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Openstack-System-Scope: None Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: User-Agent: python-novaclient Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Auth-Token: gAAAAABjD7QIjo2PqN6PEGjKx-TUcOE9PGNML_cOpdDPvhMhWiM1Cj9H2SSjFxLykll0dXnNMwKbR-4Go9okP9Xh8Wz_4JDVgvSaK72j1Ed7NApEUd464XzGeQcZSp6Y--KVSMyWvkH_UVASkCXFZGs1R1c8rnbyNOHSO-8F4YEDv25iJ09VvgA Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Domain-Id: None Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Domain-Name: None Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Identity-Status: Confirmed Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Is-Admin-Project: True Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Domain-Id: default Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Domain-Name: Default Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Name: admin Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Role: member,admin,reader Aug 31 19:18:33.518325 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Roles: member,admin,reader Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9e5945a1a4d41fca11373bc396c02fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant: admin Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant-Name: admin Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User: admin Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Domain-Id: default Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Domain-Name: Default Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Id: 30d09a6b4f0047b4ba7decc0e37bf0cf Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Name: admin Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: method: > Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: exception: Flavor 42 could not be found. Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: action_args: {'id': '42'} Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:33.520268 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:33.521682 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.523206 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-2f5df329-a03c-4da9-9fef-087dce7559a8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:33.524647 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-2f5df329-a03c-4da9-9fef-087dce7559a8 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.413567 Aug 31 19:18:33.524647 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:33.529438 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-3a2d4d44-33de-4618-9ec6-3c463ab2e127 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.534215 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:18:33.553939 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-3a2d4d44-33de-4618-9ec6-3c463ab2e127 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027994 Aug 31 19:18:33.554486 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:33.564327 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-496d0898-e363-4c90-857f-a27298287d1c admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.587349 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-496d0898-e363-4c90-857f-a27298287d1c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026596 Aug 31 19:18:33.587926 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:33.598458 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-bb42ae2f-0318-4627-b918-6764239c7a22 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:33.604559 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.wsgi [None req-bb42ae2f-0318-4627-b918-6764239c7a22 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-bb42ae2f-0318-4627-b918-6764239c7a22 admin admin] Request method failure captured: Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Accept: application/json Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Accept-Encoding: gzip, deflate Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Connection: keep-alive Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Content-Length: 0 Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Host: 10.222.0.59 Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Openstack-Api-Version: compute 2.90 Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Openstack-System-Scope: None Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: User-Agent: python-novaclient Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Auth-Token: gAAAAABjD7QIjo2PqN6PEGjKx-TUcOE9PGNML_cOpdDPvhMhWiM1Cj9H2SSjFxLykll0dXnNMwKbR-4Go9okP9Xh8Wz_4JDVgvSaK72j1Ed7NApEUd464XzGeQcZSp6Y--KVSMyWvkH_UVASkCXFZGs1R1c8rnbyNOHSO-8F4YEDv25iJ09VvgA Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Domain-Id: None Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Domain-Name: None Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Identity-Status: Confirmed Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Is-Admin-Project: True Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Domain-Id: default Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Domain-Name: Default Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Name: admin Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Role: member,admin,reader Aug 31 19:18:33.608106 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Roles: member,admin,reader Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9e5945a1a4d41fca11373bc396c02fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant: admin Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant-Name: admin Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User: admin Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Domain-Id: default Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Domain-Name: Default Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Id: 30d09a6b4f0047b4ba7decc0e37bf0cf Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Name: admin Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: method: > Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: exception: Flavor 42 could not be found. Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: action_args: {'id': '42'} Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:33.616893 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:33.617725 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:33.618793 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-bb42ae2f-0318-4627-b918-6764239c7a22 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:33.619916 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-bb42ae2f-0318-4627-b918-6764239c7a22 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015809 Aug 31 19:18:33.619916 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 31 19:18:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:34.585379 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-496d0898-e363-4c90-857f-a27298287d1c admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:34.586398 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-496d0898-e363-4c90-857f-a27298287d1c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 31 19:18:34.586793 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:35.124973 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-71609289-5a3e-41dc-8d97-b24db6f3cd83 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.131552 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.wsgi [None req-71609289-5a3e-41dc-8d97-b24db6f3cd83 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-71609289-5a3e-41dc-8d97-b24db6f3cd83 admin admin] Request method failure captured: Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Accept: application/json Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Accept-Encoding: gzip, deflate Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Connection: keep-alive Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Content-Length: 0 Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Host: 10.222.0.59 Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Openstack-Api-Version: compute 2.90 Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Openstack-System-Scope: None Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: User-Agent: python-novaclient Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Auth-Token: gAAAAABjD7QKYj5icgMFP6J2zv1qN5U-SszF0d4pr3y-Ziuk8cDaMfkjbJSrxhcvtNnfJjz-fw8Qcnbv8V4zZ35OWEhxI5DJ_NA1T95JokzGzry8oHWy0Ptc9-YfTuSAUsAuEgQOdSKCCYA9aU74wvhXknHEw52MP1ltH8taWk9IYDsKY6_Ac_Y Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Domain-Id: None Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Domain-Name: None Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Identity-Status: Confirmed Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Is-Admin-Project: True Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Domain-Id: default Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Domain-Name: Default Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Name: admin Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Role: member,admin,reader Aug 31 19:18:35.133058 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Roles: member,admin,reader Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9e5945a1a4d41fca11373bc396c02fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant: admin Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant-Name: admin Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User: admin Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Domain-Id: default Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Domain-Name: Default Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Id: 30d09a6b4f0047b4ba7decc0e37bf0cf Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Name: admin Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: method: > Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: exception: Flavor 84 could not be found. Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: action_args: {'id': '84'} Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:35.134630 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:35.135618 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.137075 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-71609289-5a3e-41dc-8d97-b24db6f3cd83 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:35.138413 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-71609289-5a3e-41dc-8d97-b24db6f3cd83 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.408386 Aug 31 19:18:35.138413 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 31 19:18:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:35.145403 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-20714792-b9bc-4500-8240-25901c0dc6c5 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.161070 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-20714792-b9bc-4500-8240-25901c0dc6c5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020295 Aug 31 19:18:35.161611 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 31 19:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:35.171176 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-a087820d-b88e-4262-a088-c88937ba2d93 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.186479 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-a087820d-b88e-4262-a088-c88937ba2d93 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018935 Aug 31 19:18:35.187040 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 31 19:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:35.197484 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5ab29c2e-afd9-4bfe-be6d-568609674a4a admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:35.202950 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.wsgi [None req-5ab29c2e-afd9-4bfe-be6d-568609674a4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5ab29c2e-afd9-4bfe-be6d-568609674a4a admin admin] Request method failure captured: Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Accept: application/json Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Accept-Encoding: gzip, deflate Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Connection: keep-alive Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Content-Length: 0 Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Host: 10.222.0.59 Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Openstack-Api-Version: compute 2.90 Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Openstack-System-Scope: None Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: User-Agent: python-novaclient Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Auth-Token: gAAAAABjD7QKYj5icgMFP6J2zv1qN5U-SszF0d4pr3y-Ziuk8cDaMfkjbJSrxhcvtNnfJjz-fw8Qcnbv8V4zZ35OWEhxI5DJ_NA1T95JokzGzry8oHWy0Ptc9-YfTuSAUsAuEgQOdSKCCYA9aU74wvhXknHEw52MP1ltH8taWk9IYDsKY6_Ac_Y Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Domain-Id: None Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Domain-Name: None Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Identity-Status: Confirmed Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Is-Admin-Project: True Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Domain-Id: default Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Domain-Name: Default Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Name: admin Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Role: member,admin,reader Aug 31 19:18:35.204511 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Roles: member,admin,reader Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9e5945a1a4d41fca11373bc396c02fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant: admin Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant-Name: admin Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User: admin Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Domain-Id: default Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Domain-Name: Default Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Id: 30d09a6b4f0047b4ba7decc0e37bf0cf Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Name: admin Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: method: > Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: exception: Flavor 84 could not be found. Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: action_args: {'id': '84'} Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:35.206945 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:35.208229 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:35.209635 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5ab29c2e-afd9-4bfe-be6d-568609674a4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:35.210947 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-5ab29c2e-afd9-4bfe-be6d-568609674a4a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012570 Aug 31 19:18:35.210947 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 31 19:18:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:36.191387 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-a087820d-b88e-4262-a088-c88937ba2d93 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.192430 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-a087820d-b88e-4262-a088-c88937ba2d93 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 31 19:18:36.192839 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:36.752598 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5f4d917e-de0c-4a35-b25f-fe8d0f8853cd admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.758475 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.wsgi [None req-5f4d917e-de0c-4a35-b25f-fe8d0f8853cd admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5f4d917e-de0c-4a35-b25f-fe8d0f8853cd admin admin] Request method failure captured: Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Accept: application/json Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Accept-Encoding: gzip, deflate Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Connection: keep-alive Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Content-Length: 0 Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Host: 10.222.0.59 Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Openstack-Api-Version: compute 2.90 Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Openstack-System-Scope: None Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: User-Agent: python-novaclient Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Auth-Token: gAAAAABjD7QMQ48IyUxfGqAz5iwwYGIqzvSuY3mzCWC6ztCOMybEaBweBX2tS7NX5fOORgVJ059Nn-7XdXK9pFpW1NCeQUmBY1VahuaJgFILBb0WOH70usdsGvIPE8MPhiVZ4sgWXhUT1MDCSgF_PNbz5YYBuZcBwCdTCf2tRDPEBK1-RfbNyQU Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Domain-Id: None Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Domain-Name: None Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Identity-Status: Confirmed Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Is-Admin-Project: True Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Domain-Id: default Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Domain-Name: Default Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Project-Name: admin Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Role: member,admin,reader Aug 31 19:18:36.760001 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Roles: member,admin,reader Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9e5945a1a4d41fca11373bc396c02fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant: admin Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-Tenant-Name: admin Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User: admin Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Domain-Id: default Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Domain-Name: Default Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Id: 30d09a6b4f0047b4ba7decc0e37bf0cf Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: X-User-Name: admin Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: method: > Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: exception: Flavor 451 could not be found. Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: action_args: {'id': '451'} Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:36.761717 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:36.762648 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.763991 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-5f4d917e-de0c-4a35-b25f-fe8d0f8853cd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:36.765283 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-5f4d917e-de0c-4a35-b25f-fe8d0f8853cd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.425766 Aug 31 19:18:36.765283 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:36.772091 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-4f640adf-9a4e-4d92-aa49-3ef7723edf77 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.786710 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-4f640adf-9a4e-4d92-aa49-3ef7723edf77 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018283 Aug 31 19:18:36.787268 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:36.797042 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.811905 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018594 Aug 31 19:18:36.812430 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:18:36.822480 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-923309cb-c5f2-464c-a099-a22494f3dad4 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:36.827902 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.wsgi [None req-923309cb-c5f2-464c-a099-a22494f3dad4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-923309cb-c5f2-464c-a099-a22494f3dad4 admin admin] Request method failure captured: Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Accept: application/json Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Accept-Encoding: gzip, deflate Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Connection: keep-alive Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Content-Length: 0 Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Host: 10.222.0.59 Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Openstack-Api-Version: compute 2.90 Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Openstack-System-Scope: None Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: User-Agent: python-novaclient Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Auth-Token: gAAAAABjD7QMQ48IyUxfGqAz5iwwYGIqzvSuY3mzCWC6ztCOMybEaBweBX2tS7NX5fOORgVJ059Nn-7XdXK9pFpW1NCeQUmBY1VahuaJgFILBb0WOH70usdsGvIPE8MPhiVZ4sgWXhUT1MDCSgF_PNbz5YYBuZcBwCdTCf2tRDPEBK1-RfbNyQU Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Domain-Id: None Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Domain-Name: None Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Identity-Status: Confirmed Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Is-Admin-Project: True Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Domain-Id: default Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Domain-Name: Default Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Project-Name: admin Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Role: member,admin,reader Aug 31 19:18:36.829408 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Roles: member,admin,reader Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c9e5945a1a4d41fca11373bc396c02fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c9e5945a1a4d41fca11373bc396c02fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant: admin Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant-Id: c9e5945a1a4d41fca11373bc396c02fd Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-Tenant-Name: admin Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User: admin Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Domain-Id: default Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Domain-Name: Default Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Id: 30d09a6b4f0047b4ba7decc0e37bf0cf Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: X-User-Name: admin Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: method: > Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: exception: Flavor 451 could not be found. Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: action_args: {'id': '451'} Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:18:36.831661 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:36.832625 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: ERROR nova.api.openstack.wsgi Aug 31 19:18:36.833957 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-923309cb-c5f2-464c-a099-a22494f3dad4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:18:36.835233 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-923309cb-c5f2-464c-a099-a22494f3dad4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012541 Aug 31 19:18:36.835233 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 31 19:18:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 19:18:37.829050 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:37.830691 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 19:18:37.831203 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:38.371179 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-fbbfe0fe-8393-4231-8bee-2aa6dea5cfed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:38.449447 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-fbbfe0fe-8393-4231-8bee-2aa6dea5cfed admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.476994 Aug 31 19:18:38.450007 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 31 19:18:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:18:39.452258 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:39.453281 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 31 19:18:39.453687 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:40.007039 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-05571e7a-18e2-441d-b009-740e5cf2b39f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:40.112333 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-05571e7a-18e2-441d-b009-740e5cf2b39f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.517478 Aug 31 19:18:40.112892 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 31 19:18:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:41.230887 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:41.232264 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001784 Aug 31 19:18:41.232641 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:41.780197 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-3cacb67c-5fac-4a38-9cae-a69cf1fc8d24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:41.878298 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-3cacb67c-5fac-4a38-9cae-a69cf1fc8d24 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.507591 Aug 31 19:18:41.878843 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 31 19:18:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:42.862442 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:42.863480 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 31 19:18:42.863896 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:18:43.406931 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-0d28e2ae-9dd9-45ec-9828-f02be9ef195b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:18:43.512610 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-0d28e2ae-9dd9-45ec-9828-f02be9ef195b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.504204 Aug 31 19:18:43.513160 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 31 19:18:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:18:44.515802 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:44.516816 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 31 19:18:44.517755 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:18:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:18:45.046363 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-95de8d29-7861-49f4-ba48-74b5bdfb7bdd admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:18:45.072664 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-95de8d29-7861-49f4-ba48-74b5bdfb7bdd admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412490 Aug 31 19:18:45.073241 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Wed Aug 31 19:18:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:19:39.393036 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.394057 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-b8371f12-84a5-4c1b-ac2a-4c6bdfbaca91 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 31 19:19:39.394464 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:19:39.405152 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:39.788813 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-575514a2-b9ec-4507-973e-19640c6f3dfc admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.810137 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-575514a2-b9ec-4507-973e-19640c6f3dfc admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409411 Aug 31 19:19:39.810603 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:19:39.831358 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG dbcounter [-] [106156] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:19:39.835091 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-6dad064d-b141-41ad-844a-c1f98d6da766 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.842518 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-6dad064d-b141-41ad-844a-c1f98d6da766 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012676 Aug 31 19:19:39.843070 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:19:39.855275 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-d1746259-03bc-4a7c-83b1-77dde3e62527 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.864040 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-d1746259-03bc-4a7c-83b1-77dde3e62527 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012386 Aug 31 19:19:39.864567 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:39.876242 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.884267 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011930 Aug 31 19:19:39.884786 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:19:39.896458 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-ec2e8b65-39fb-4a54-87b6-df90b40acf1c admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:19:39.904083 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-ec2e8b65-39fb-4a54-87b6-df90b40acf1c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011197 Aug 31 19:19:39.904623 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Wed Aug 31 19:19:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:22:55.081915 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.082966 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 19:22:55.083471 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:22:55.234196 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_api:SELECT=6 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:22:55.400405 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:55.404441 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.404970 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.405451 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.406266 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:55.406792 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:55.407434 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:55.446062 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-3fe5b8d9-144d-41f2-a6c7-fb8a7138aea5 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.213424 Aug 31 19:22:55.446633 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 31 19:22:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:22:56.283986 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.284999 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 19:22:56.285397 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:22:56.481497 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:22:56.484943 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.485537 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.485971 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.486691 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:22:56.487170 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:22:56.487590 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:22:56.508194 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-a27f0b30-fe5b-4ac1-a190-d16ca9050c07 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079748 Aug 31 19:22:56.508680 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 31 19:22:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:23:07.807786 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:07.807786 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 31 19:23:07.807786 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:23:07.955523 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_cell0:SELECT=4 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:07.956276 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_cell1:SELECT=4 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:07.956889 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG dbcounter [-] [106155] Writing DB stats nova_api:SELECT=8 {{(pid=106155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:23:08.009623 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:08.012677 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:08.013149 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:08.013656 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:08.014472 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:08.014944 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:08.015397 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:08.042353 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-03ee7341-d5b5-4c64-9b4b-13af41a4fc8b admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091428 Aug 31 19:23:08.043384 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 31 19:23:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:23:08.893031 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: DEBUG nova.api.openstack.wsgi [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] Calling method '>' {{(pid=106156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:08.894029 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: INFO nova.api.openstack.requestlog [None req-c0b07647-c0fc-48ed-8c06-2e64a97cf3d9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 31 19:23:08.894426 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: [pid: 106156|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 31 19:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:23:09.091926 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG nova.api.openstack.wsgi [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Calling method '>' {{(pid=106155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:23:09.096278 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.096741 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.097172 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.097895 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:23:09.098395 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:23:09.098763 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: DEBUG oslo_concurrency.lockutils [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:23:09.122057 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: INFO nova.api.openstack.requestlog [None req-f7a9b334-a190-4178-a044-1083741c547e admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084087 Aug 31 19:23:09.122615 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: [pid: 106155|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 31 19:23:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:24:08.366829 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: Wed Aug 31 19:24:08 2022 - graceful shutdown triggered... Aug 31 19:24:08.366983 dv-cinder-852209-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 19:24:08.367994 dv-cinder-852209-9-iscsi devstack@n-api.service[106155]: Gracefully killing worker 1 (pid: 106155)... Aug 31 19:24:08.369529 dv-cinder-852209-9-iscsi devstack@n-api.service[106156]: Gracefully killing worker 2 (pid: 106156)... Aug 31 19:24:09.369075 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: worker 1 buried after 1 seconds Aug 31 19:24:09.369075 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: worker 2 buried after 1 seconds Aug 31 19:24:09.369075 dv-cinder-852209-9-iscsi devstack@n-api.service[106154]: goodbye to uWSGI. Aug 31 19:24:09.370628 dv-cinder-852209-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 19:24:09.371205 dv-cinder-852209-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 19:24:09.374208 dv-cinder-852209-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 19:24:09.383609 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 19:24:09.386199 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 19:24:09 2022] *** Aug 31 19:24:09.386368 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 19:24:09.386508 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 19:24:09.386628 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: nodename: dv-cinder-852209-9-iscsi Aug 31 19:24:09.386742 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: machine: x86_64 Aug 31 19:24:09.386854 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: clock source: unix Aug 31 19:24:09.387502 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: pcre jit disabled Aug 31 19:24:09.387676 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: detected number of CPU cores: 4 Aug 31 19:24:09.387802 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: current working directory: / Aug 31 19:24:09.387979 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: detected binary path: /usr/bin/uwsgi-core Aug 31 19:24:09.387979 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: your processes number limit is 47680 Aug 31 19:24:09.387979 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: your memory page size is 4096 bytes Aug 31 19:24:09.387979 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: detected max file descriptor number: 2048 Aug 31 19:24:09.387979 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: lock engine: pthread robust mutexes Aug 31 19:24:09.388377 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: thunder lock: enabled Aug 31 19:24:09.388377 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 19:24:09.388513 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 19:24:09.429065 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: Python main interpreter initialized at 0x55c2bfcb09c0 Aug 31 19:24:09.429065 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: python threads support enabled Aug 31 19:24:09.429065 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: your server socket listen backlog is limited to 100 connections Aug 31 19:24:09.429065 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: your mercy for graceful operations on workers is 90 seconds Aug 31 19:24:09.429522 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 19:24:09.429522 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: *** Operational MODE: preforking *** Aug 31 19:24:09.429794 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: *** uWSGI is running in multiple interpreter mode *** Aug 31 19:24:09.429794 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: spawned uWSGI master process (pid: 121171) Aug 31 19:24:09.432981 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: spawned uWSGI worker 1 (pid: 121186, cores: 1) Aug 31 19:24:09.432981 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: spawned uWSGI worker 2 (pid: 121187, cores: 1) Aug 31 19:24:09.432981 dv-cinder-852209-9-iscsi devstack@n-api.service[121171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 19:24:09.430009 dv-cinder-852209-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 19:24:10.113659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:24:10.118041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 19:24:11.302015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:24:11.302015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: from cryptography.utils import int_from_bytes Aug 31 19:24:11.302676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:24:11.302676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: from cryptography.utils import int_from_bytes Aug 31 19:24:11.313129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:24:11.313129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: from cryptography.utils import int_from_bytes Aug 31 19:24:11.313712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 19:24:11.313712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: from cryptography.utils import int_from_bytes Aug 31 19:24:13.750793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:24:13.751431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:24:13.751682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:24:13.752022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:24:13.752292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:24:13.752701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.753049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.753393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.753730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.754109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.754398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.754740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.755106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.755450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.755734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.756046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.756389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-9-iscsi {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.756903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.757227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.757556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.757943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.758266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.758609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.758976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.759517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.761182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.761182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.761182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.762544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.762544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.762544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.763403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.763403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.763853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.763853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.764274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-9-iscsi {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.764509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.764829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.765146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.765600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.766012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.766231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.766561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.766960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.767836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.767836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.771408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.776871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.778748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.779885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.781013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.782125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.783141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.783141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.783141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.783572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.783730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.783922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.784240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.784551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.784868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.785188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.785510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.785839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.786235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.786446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.786787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.787153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.787409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.787742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.788073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.788394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.788711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.789029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.789359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.789680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.790000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.790321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.790657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.790997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.791832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.791832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.792143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.792286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.792570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.792881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.793790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.794316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.794765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.795124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.795450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.795776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.796505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.796505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.796815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.797028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.797325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.797662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.798002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.798325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.798646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.799113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.799325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.799683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.800029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.800435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.800761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.801021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 19:24:13.801596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.801761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 19:24:13.801916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.801916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.802211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 19:24:13.802355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.802512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 19:24:13.802669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.803407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 19:24:13.803586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.804284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.804449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.804606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.804760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.804916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.805070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.805225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.805369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.805521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.805673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.805824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.806016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.806180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.806339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.806597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.806824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.807016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.807171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.807409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.807591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.807744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.807888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.808055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-9-iscsi {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.808298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.808457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.808686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.808686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.809864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.809864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.810159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.810329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.810572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.810825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.811224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.811427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.811593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.811753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.811905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.811905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.811905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.812327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.812501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.812661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.812829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.812981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.813124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.813273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.813424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.813577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.813729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.813884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.814035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.814178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.814337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.814490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.814651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.814805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.814990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.815146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.815298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.815441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.815595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.815748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-9-iscsi {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.815891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.816047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.816250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.816403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.816565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.816988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.817148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.817148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.817538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.817691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.817842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.817987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.818144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.818307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.818554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.818715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.818859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.819039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.819205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.819352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.819500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.819911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.820069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.820217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.820373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.820518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.820660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.820812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.820955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.821105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.821258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.821412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.821561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.821704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.821848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.822005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.822155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.822298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.822440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.822440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.822728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.822924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.823075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.823075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.823358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.823510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.823654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.823809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.823964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.823964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.824257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.824402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.824555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.824705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.824849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.825028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.825275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.825514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.825687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.825841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.825993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.826137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.826332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.826483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.826636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.826797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.827117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.827278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.827436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.827680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.827831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.827982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.828127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.828276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.828434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.828608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.828843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.828843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.829136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.829136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.829427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.829584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.829760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.829760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.830295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.830295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.830583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.830790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.831000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.831148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.831292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.831441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.831598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.831763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.831919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.832062 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.832204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.832204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.832475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.832475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.832753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.832903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.833046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.833195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.833339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.833339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.833640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.833791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.833934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.834077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.834227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.834227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.834515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.834664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.834807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.834993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.835139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.835331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.835502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.835646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.835788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.835929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.836070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.836222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.836422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.836577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.836728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.836878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.837253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.837407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.837552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.837795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.837955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.838106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.838259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.838410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.838564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.838708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.838880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.839142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.839308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.839459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.839609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.839761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.839927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.840337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.840509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.840656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.840801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.840951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.841095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.841251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.841403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.841546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.841688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.841841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.841985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.842138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.842281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.842430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.842588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.842739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.842954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.843116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.843260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.843408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.843571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.843723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.843874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.844023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.844183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.844335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.844487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.844630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.844779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.844931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.845081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.845231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.845388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.845540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.845690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.845841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.846002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.846160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.846311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.846510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.846654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.846804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.846969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.847290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.847452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.847603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.847753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.847992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.848148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.848312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.848463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.848614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.848757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.848914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.849076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.849329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.849485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.849629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.849771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.849919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.850065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.850399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.850656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.850814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.851040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.851195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 19:24:13.851353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.851496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.851824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.852400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.852816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.852966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.853127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.853273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.853457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.853630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.853776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.853925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.854087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.854245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.854397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.854546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.854703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.854861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.855045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.855045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.855347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.855514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.856189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.856393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.856597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.856756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.856982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.857134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.857458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.857635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.857795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.857969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.858210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.858365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.858527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.858687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.858836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.859024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.859185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.859361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.859617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.859781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.859949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.860101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.860256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.860582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.860851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.861951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.862108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.862266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.862266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.862565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.862725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.862911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.863992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.864151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.864307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.864466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.864616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.864765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.864925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.865190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.865364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.865655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.865811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.865969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.866126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.866277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.866426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.866628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.866791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.867059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.867228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.867398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.867730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.867889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.868047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.868225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.868459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.868624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.868784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.868935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.869085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.869234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.869390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.869539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.869903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.870064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.870064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.870357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.870527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.870879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.871147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.871321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.872094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.872306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.872469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.872627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.872792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.873957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.874132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.874396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.874561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.874713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.874862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.875088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.875248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.875409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.875560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.875756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.875919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.876069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.876232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.876383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.876531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.876727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.876889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.877040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.877213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.877365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.877521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.877844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.878012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.878163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.878321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.878491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.878729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.878909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.879076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.879227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.879390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.879560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.879711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.879989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.880161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.880322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.880473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.880623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.880947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.881109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.881266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.881524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.881681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.881832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.882968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.883125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.883284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.883443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.883592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.883742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.883910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.884994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.885151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.885358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.885510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.885659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.885816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.885984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.886144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.886294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.886443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.886600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.886892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.887077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.887244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.887402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.887553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.887702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.888008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.888178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.888348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.888499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.888649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.889197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.889366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.889532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.889690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.889842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.890024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.890263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.890427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.890588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.890746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.891081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.891242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.891401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.891571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.891814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.891970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.892121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.892277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.892434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.892593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.892753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.892910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.893080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.893240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.893390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.893552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.893703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.893852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.894976 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.895909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.896945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.897931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.898205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.898348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.898487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.898627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.898758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.898939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.899977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.900122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.900267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.900497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.900631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.900769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.900906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.901207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.901344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.901488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.901619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.901748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.901975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.902115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.902246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.902394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.902616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.902825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.902825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.903973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.904889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.905936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.906864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.907970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.908366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.908511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.908651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.908781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.908781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.909990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.910127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.910127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.910378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.910530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.910530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.910862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.911994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.912333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.912463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.912607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.912738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.912738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.912991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.913786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.914843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.915798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.916843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.917924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.918054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.918054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.919917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.920913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.921890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.922159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.922389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.922532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.922669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.922807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.922984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.923154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.923424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.923589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.923873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.924020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.924243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.924383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.924581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.924809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.924943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.925226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.925365 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.925545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.925870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.926340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.926498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.926809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.926989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.927306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.927541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.927760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.927894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.928187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.928326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.928518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.928877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.929030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.929175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.929306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.929443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.929703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.929861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.930100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.930232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.930440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.930616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.930772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.931083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.931227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.931484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.931774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.931915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.932132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.932346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.932584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.932780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.932912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.933102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.933273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.933413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.933818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.934669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.935039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.935351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.935702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.935847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.936041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.936246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.936490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.936720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.936863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.937066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.937237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.937400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.937656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.937806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.938045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.938186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.938365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.938590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.938725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.939034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.939315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.939456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.939603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.939757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.939965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.940107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.940279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.940476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.940611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.941296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.941436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.941578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.941710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.942012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.942148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.942278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.942278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.942829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.943999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.944130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.944396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.944544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.944734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.944975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.945109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.945385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.945524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.945795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.946043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.946175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.947103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.947286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.947428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.947567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.947711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.947711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.948878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.949035 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.949357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.949498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.949636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.949897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.950143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.950274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.950477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.950620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.950860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.958502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.958664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.958821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.958989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.959122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.959428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.959428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.959858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.959997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.960991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.961997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.962939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.963938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.964930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.965899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.966940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.967851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.968994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.969945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970118 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.970988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.971923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.972947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973466 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.973822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.974064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.974159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.974382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.974532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.974703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.974799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.975051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.975147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.975380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.975487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.975699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.975792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.976980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.977074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.977295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.977400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.977868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.977973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.978182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.978281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.978498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.978610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.978812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.978941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.979159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.979260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.979494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.979602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.979841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.979989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.980224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.980382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.980526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.981299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.981437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.981629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.981884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.982024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.982262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.982446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.982743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.982947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.983922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.984062 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.984200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.984334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.984495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.984639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.984833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.985053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.985197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.985377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.985522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.985704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.985833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.986125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.986445 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.986787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.986943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.987177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.987321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.987476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.987647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.987787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.987920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.988160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.988314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.988431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.988553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.988718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.988846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.989042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.989174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.989367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.989554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.989671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.989793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.990987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.991113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.991319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.995393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.995532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.995642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.995788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.995887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.996013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.996115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.996236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.997955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.998996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:13.999959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.000853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.001904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.002820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.003887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.004970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.005920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.006880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.007976 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.008135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.008412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.008559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.008753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.008854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.009070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.009180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.009416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.009519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.009750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.009848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.010081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.010204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.010412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.010518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.010733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.010826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.011093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.011204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.011420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.011543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.011755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.012378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.012614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.012921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.013913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.014057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.014238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.014391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.014667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.014801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.014979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.015072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.015254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.015349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.015641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.015797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.015930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.016071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.016250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.016396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.016570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.016706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.016907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.017044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.017239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.017389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.017574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.017718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.017904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.018049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.018228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.018375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.018569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.018706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.018953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.019087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.019231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.019363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.019537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.019671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.019862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.020029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.020196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.020340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.020554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.020698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.020838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.021948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.022135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.022297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.022474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.022755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.022945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.030807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.031915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.032836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.033659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.034499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.034499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.034499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.034940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.035142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.035469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.035797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.036338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.036720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.037078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.037441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.037772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.038099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.038428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.038766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.039116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.039432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.039754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.040075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.040418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.040752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.041079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.041399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.041792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.042121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.042704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.043088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.043435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.043872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.044219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.044547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.044916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.045264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.045578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.045893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.046219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.046540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.046855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.047188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.047510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.047856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.048170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.048488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.048803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.049141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.049457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.049770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.050085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.050407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.050722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.051064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.051510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.051684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.052005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.052318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.052689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.053010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.053353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.053670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.053993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.054356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.054789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.055128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.055443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.055772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.056093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.056429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.056752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.057075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.057431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.057754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.058307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.058652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.059138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.059530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.059927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.060218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.060587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.060905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.061241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.061564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.061889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.062210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.062530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.062856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.063197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.063520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.063841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.064168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.064487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.064808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.065128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.065461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.065770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.066094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.066446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.066777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.067134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.067466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.067797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.068115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.068436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.068756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.069073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.069401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.069738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.070061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.070376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.070844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.073567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.074141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.074141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.074998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.075474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.075839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.076159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.076475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.076796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.077145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.077473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.077797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.078110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.078424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.078748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.079088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.079405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.079720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.080033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.080353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.080663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.080975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.081286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.081596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.081908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.082223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.082537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.082851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.083196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.083509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.083820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.084139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.084481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.084824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.085149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.085530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.085804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.086204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.086524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.086855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.087203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.087529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.087847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.088193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.088490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO dbcounter [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Registered counter for database nova_api Aug 31 19:24:14.088627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.088846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.089168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.089490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.089812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.090956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.091304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.091645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.091962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.092303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.092633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.092966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.094098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.094424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.094782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.095134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.095463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.095786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.096117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.096508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.096965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.097165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.097642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.098149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.098312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.098763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.099129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.099591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.099832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.100185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.100552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.100879 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.101238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.101580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.101906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.102230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.102791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 19:24:14.103074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 19:24:14.110173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.117098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writer thread running {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.166588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO dbcounter [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Registered counter for database nova_api Aug 31 19:24:14.174733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.context [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3de6f35d-b6ae-4864-abed-e50e71414e62(cell1) {{(pid=121186) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:24:14.178818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.179332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.180934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.181679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.182138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.184727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.186969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO dbcounter [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Registered counter for database nova_cell0 Aug 31 19:24:14.188331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_db.sqlalchemy.engines [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.191173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO dbcounter [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Registered counter for database nova_cell1 Aug 31 19:24:14.198701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.201148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.204637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writer thread running {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.207137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writer thread running {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.209240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writer thread running {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.262632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.context [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3de6f35d-b6ae-4864-abed-e50e71414e62(cell1) {{(pid=121187) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 19:24:14.267189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.267712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.269333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.270088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:24:14.270544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:24:14.272996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:24:14.275265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO dbcounter [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Registered counter for database nova_cell0 Aug 31 19:24:14.279810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO dbcounter [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Registered counter for database nova_cell1 Aug 31 19:24:14.287152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_db.sqlalchemy.engines [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.290575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_db.sqlalchemy.engines [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.298483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writer thread running {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.298836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writer thread running {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.361493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO dbcounter [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Registered counter for database nova_cell0 Aug 31 19:24:14.368594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.374541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writer thread running {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.455176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO dbcounter [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Registered counter for database nova_cell0 Aug 31 19:24:14.463567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_db.sqlalchemy.engines [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 19:24:14.468542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writer thread running {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 19:24:14.702539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: WARNING keystonemiddleware.auth_token [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:24:14.709972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: WARNING keystonemiddleware.auth_token [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:24:14.792505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: WARNING keystonemiddleware.auth_token [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:24:14.800445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: WARNING keystonemiddleware.auth_token [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:24:15.063750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: WARNING keystonemiddleware.auth_token [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:24:15.069889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: WARNING keystonemiddleware.auth_token [None req-1b4789a9-9bcf-4351-9169-d8802cd05070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:24:15.075636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2bfcb09c0 pid: 121186 (default app) Aug 31 19:24:15.148276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: WARNING keystonemiddleware.auth_token [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 19:24:15.155126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: WARNING keystonemiddleware.auth_token [None req-91dd8c99-6872-44da-a470-5a715df5ddd7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 19:24:15.160847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2bfcb09c0 pid: 121187 (default app) Aug 31 19:24:52.532294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:52.533203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:52.534093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:52.534837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:53.503003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:53.503918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:53.504736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:53.505742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:24:53.612896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d5e34c55-a594-40eb-bdb4-59fb8fef7ded tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Action: 'create', calling method: .version_select at 0x7ff6cc4210d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1740144112", "metadata": {"Type": "work"}}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:54.883532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e419549f-7b22-4899-aeac-5b5c066b95df tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Action: 'create', calling method: .version_select at 0x7ff6cc41b0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-419851790"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:56.104307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d5e34c55-a594-40eb-bdb4-59fb8fef7ded tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.583824 Aug 31 19:24:56.105367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 31 19:24:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3587 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 19:24:56.121957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-55c421b7-53d4-4cf4-bdc4-32795f27d712 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc2eef70>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:56.426583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-55c421b7-53d4-4cf4-bdc4-32795f27d712 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 200 len: 353 microversion: 2.1 time: 0.256326 Aug 31 19:24:56.426583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 2/2] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:56 2022] GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:56.843672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e419549f-7b22-4899-aeac-5b5c066b95df tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.347073 Aug 31 19:24:56.847098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1155 bytes} [Wed Aug 31 19:24:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3352 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 19:24:56.861621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-27eb5013-834a-4fc0-8e20-5e3b54df0a5e tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc304670>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:56.957176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-27eb5013-834a-4fc0-8e20-5e3b54df0a5e tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 200 len: 344 microversion: 2.1 time: 0.100082 Aug 31 19:24:56.963523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:56 2022] GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:57.393261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c21be798-8534-4710-b5b2-08796e7d626f tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc2edf70>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:57.486920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c21be798-8534-4710-b5b2-08796e7d626f tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 200 len: 353 microversion: 2.1 time: 0.101829 Aug 31 19:24:57.495859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 2/5] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:57 2022] GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:58.092763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5e66b780-08d8-4b40-86b5-0eef9bfea6f0 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc304e50>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:58.205528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5e66b780-08d8-4b40-86b5-0eef9bfea6f0 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 200 len: 344 microversion: 2.1 time: 0.238055 Aug 31 19:24:58.206228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 4/6] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:57 2022] GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 344 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:58.501798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0b4297d5-ea38-4f7d-b499-584e8939972f tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc302700>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:58.845628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0b4297d5-ea38-4f7d-b499-584e8939972f tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 200 len: 354 microversion: 2.1 time: 0.348177 Aug 31 19:24:58.847043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 3/7] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:58 2022] GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 354 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:58.861389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-70126734-0dde-4a01-b946-5ffb3a5d1083 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc304ca0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:58.966766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-70126734-0dde-4a01-b946-5ffb3a5d1083 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 200 len: 354 microversion: 2.1 time: 0.111375 Aug 31 19:24:58.967750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 5/8] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:58 2022] GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:24:58.990847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6f7876bf-0c48-4cd9-ab77-229e3eafad26 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc302dc0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:59.221151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3ea134a7-39b7-46b8-9af5-a21fe349ee2f tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc3044c0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:59.295816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6f7876bf-0c48-4cd9-ab77-229e3eafad26 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 202 len: 0 microversion: 2.1 time: 0.309251 Aug 31 19:24:59.296768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 4/9] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:24:58 2022] DELETE /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:24:59.305733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-355854dc-9b77-4788-9b5a-529d9ac0870c tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc302b80>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:24:59.382094 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3ea134a7-39b7-46b8-9af5-a21fe349ee2f tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 200 len: 345 microversion: 2.1 time: 0.166816 Aug 31 19:24:59.391246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 6/10] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:59 2022] GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 345 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:24:59.396760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7d3b5c6d-3c7c-48a5-a215-d90c61ea848b tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Action: 'create', calling method: .version_select at 0x7ff6cc2eee50>, body: {"snapshot": {"volume_id": "a6198760-46ab-47f6-8a75-59988fcc15ac", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2018457230"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:24:59.421809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-355854dc-9b77-4788-9b5a-529d9ac0870c tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 200 len: 353 microversion: 2.1 time: 0.120862 Aug 31 19:24:59.422956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 5/11] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:24:59 2022] GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:00.073053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7d3b5c6d-3c7c-48a5-a215-d90c61ea848b tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.680460 Aug 31 19:25:00.073774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 7/12] 10.222.0.59 () {60 vars in 1162 bytes} [Wed Aug 31 19:24:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:00.088236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8ab2d30e-c24e-449b-bc78-2b261b1114ab tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc3024c0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.259862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8ab2d30e-c24e-449b-bc78-2b261b1114ab tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.177764 Aug 31 19:25:00.261063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 6/13] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:00.346119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c1ea2557-c0a1-4a0f-8c96-2b99562066e3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc304a60>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.412944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c1ea2557-c0a1-4a0f-8c96-2b99562066e3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.143801 Aug 31 19:25:00.414523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 8/14] 10.222.0.59 () {58 vars in 1140 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:00.426530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-60b21672-d196-4819-a8d5-d174973fbf82 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc2edd30>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.437866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4c83360e-4709-4f5b-88ae-163b44851d85 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Calling method '.version_select at 0x7ff6cc30aaf0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:00.489573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-4c83360e-4709-4f5b-88ae-163b44851d85 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] HTTP exception thrown: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. Aug 31 19:25:00.490260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-60b21672-d196-4819-a8d5-d174973fbf82 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.067788 Aug 31 19:25:00.495428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 7/15] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4c83360e-4709-4f5b-88ae-163b44851d85 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Request method failure captured: Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab HTTP/1.1 Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WEQfqF1qz6T1LIdKu8lAO8oiqNbdC3BUOQLsRbWQOkl-c50rXt-CwSfh5Pg3JdYRlNO-rMR6qi5qSAvAiLNJyT3mihWL5hZdAo6T3qDx5TB1lOQf8VOLFyq4LaFeUHB60zyHEK5ZE1ujeQ5YlMF_UrAU0jAzJLqQbT8bZUF63YfHk Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 7239e9b25901478398e787e38e51725f Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesGetTestJSON-144679057 Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:25:00.498794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7239e9b25901478398e787e38e51725f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7239e9b25901478398e787e38e51725f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7239e9b25901478398e787e38e51725f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7239e9b25901478398e787e38e51725f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesGetTestJSON-144679057 Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 7239e9b25901478398e787e38e51725f Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesGetTestJSON-144679057 Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesGetTestJSON-144679057-project Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 793b30c8c0df4e789e745fe4a1a10eea Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesGetTestJSON-144679057-project Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '32c32915-8853-4103-ba22-18fbb44d6eab'} Aug 31 19:25:00.500047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. (HTTP 404) (Request-ID: req-0830a83c-f756-41af-aecc-b68d0408811a) Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:00.500894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:00.502823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:25:00.504276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4c83360e-4709-4f5b-88ae-163b44851d85 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] Returning 404 to user: Volume 32c32915-8853-4103-ba22-18fbb44d6eab could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:00.505438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4c83360e-4709-4f5b-88ae-163b44851d85 tempest-VolumesGetTestJSON-144679057 tempest-VolumesGetTestJSON-144679057-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab" status: 404 len: 109 microversion: 2.1 time: 0.068248 Aug 31 19:25:00.508630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 9/16] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:00 2022] GET /compute/v2.1/os-volumes/32c32915-8853-4103-ba22-18fbb44d6eab => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:25:01.506653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ded49eb6-5507-4882-b0ca-3acc921d3af5 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc3021f0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:01.580411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ded49eb6-5507-4882-b0ca-3acc921d3af5 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.080335 Aug 31 19:25:01.581911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:01 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:02.595160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09788307-24f8-4c2b-84b2-30aa943b8e78 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc30a5e0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:02.678661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09788307-24f8-4c2b-84b2-30aa943b8e78 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.087990 Aug 31 19:25:02.679542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 10/18] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:02 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:03.697404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cab72591-22b5-45cb-aea5-627f5d2efe9d tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc302940>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:03.750763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cab72591-22b5-45cb-aea5-627f5d2efe9d tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.063281 Aug 31 19:25:03.751776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 9/19] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:03 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:04.772196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a52ed294-0459-4ed2-a0f6-630676ab8296 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc30aee0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:04.833635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a52ed294-0459-4ed2-a0f6-630676ab8296 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.072705 Aug 31 19:25:04.835405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 11/20] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:04 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:05.849902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-aca44b32-b8ee-486b-a78e-4e18dfa1cf8c tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc41be50>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:05.933809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-aca44b32-b8ee-486b-a78e-4e18dfa1cf8c tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.090502 Aug 31 19:25:05.934422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 10/21] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:05 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:06.952914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-771bcb3d-abc2-4884-8665-87cd46c6a519 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc30ad30>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:07.021297 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-771bcb3d-abc2-4884-8665-87cd46c6a519 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.077735 Aug 31 19:25:07.025401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 12/22] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:06 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:08.036172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1504e0a0-38d5-49c5-a6e1-12c93077a655 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc30ac10>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:08.193355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1504e0a0-38d5-49c5-a6e1-12c93077a655 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 288 microversion: 2.1 time: 0.163061 Aug 31 19:25:08.193929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 13/23] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:08 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 288 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:08.205918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7995be93-8bd4-4ee1-aa50-9f7a78022f8e tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc278670>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:08.236199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1919795830", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:08.454190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7995be93-8bd4-4ee1-aa50-9f7a78022f8e tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 202 len: 0 microversion: 2.1 time: 0.253242 Aug 31 19:25:08.455269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 14/24] 10.222.0.59 () {58 vars in 1254 bytes} [Wed Aug 31 19:25:08 2022] DELETE /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:25:08.463972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-11f74690-de9b-47d3-bc65-d8376659acbe tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc278d30>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:08.561250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] validate_networks() for [('e413f1b1-2e66-4271-87c8-7a5825a65e8e', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:25:08.803135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-11f74690-de9b-47d3-bc65-d8376659acbe tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.343400 Aug 31 19:25:08.803822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 15/25] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:08 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:08.922362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1081686563", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "networks": [{"uuid": "7091339a-8061-433a-8ee5-8c16a7ca6b3c"}]}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:09.186021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] validate_networks() for [('7091339a-8061-433a-8ee5-8c16a7ca6b3c', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:25:10.868164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:25:10.868649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:25:10.869058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:25:10.869494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:25:10.869902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:25:10.919955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:10.920617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:10.922920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:10.923882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:10.924483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:10.925253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:10.984022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:10.995812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for user d441bbdb43c5403abf8480146bc15753 and project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:11.030717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:25:11.035019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:25:11.237253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a0fe49f3-e096-4410-ac0f-a2e75a0f4144 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.394646 Aug 31 19:25:11.241469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 11/26] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:25:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:25:11.255473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2b699806-ce02-4adb-b97c-59fc7dd65230 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cb99b700>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:11.352395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2b699806-ce02-4adb-b97c-59fc7dd65230 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.095891 Aug 31 19:25:11.352395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 12/27] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:11 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:11.520163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:25:11.520163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:25:11.521039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:25:11.521553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:25:11.522717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:25:11.553852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:11.559612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:11.561842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:11.564718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:11.565471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:11.570061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:11.683083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Getting quotas for project fa8bb54679c74f039eee057c2b4a84f7. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:11.706359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5b307165-c42d-4339-8dd6-6d8b13f91198 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: .version_select at 0x7ff6cb99bdc0>, body: {"keypair": {"name": "tempest-keypair-710140689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKZ7/A2Pfv8v7b4TjWgh6BkJrQ778Pl2XQO0YWC7oVsSau95cOfGw6J47Gmo8xiMz9XSLt20KdcJhzUBu2PETFbbdKTGsAzBfTGb2NAC2Y8gQ4eG4kKIogjQxMLt8gcXg=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:11.713494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Getting quotas for user 7aaa082f2b754cf5aa941586361c1877 and project fa8bb54679c74f039eee057c2b4a84f7. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:11.775516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-5b307165-c42d-4339-8dd6-6d8b13f91198 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for project a13c903a376b46508e8cccbcb20b484c. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:11.784491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:25:11.795507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-5b307165-c42d-4339-8dd6-6d8b13f91198 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for user 8bc4801f1f674f55b57d49e5f09205ea and project a13c903a376b46508e8cccbcb20b484c. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:11.796280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:25:12.000483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5b307165-c42d-4339-8dd6-6d8b13f91198 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.655441 Aug 31 19:25:12.001792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 13/28] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:25:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:12.023774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-265d0161-92f6-4f32-b7b6-ac816b775656 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:12.031406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-265d0161-92f6-4f32-b7b6-ac816b775656 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:12.105687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d317acbf-b044-4d53-9b3e-d3a8b0d2c834 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.300389 Aug 31 19:25:12.107615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 16/29] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:25:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:25:12.328452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9b220916-77d1-4f1a-a38d-9927d85d5b23 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'create', calling method: .version_select at 0x7ff6cc172c10>, body: {"keypair": {"name": "tempest-keypair-1753768347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyAnXpKieFHDK3F49rpLkrVE6Z/eWTjdpcDvXzhav+N80B1LdRMo8GVpyncnxMcW7mxboXzZwKFYf9NTEVRtoAeUK+HuGxTzGcBT09i3d1zwidX2Qrgm9WSnUsl5lcp8Q=="}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:12.387475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-265d0161-92f6-4f32-b7b6-ac816b775656 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:12.405008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-9b220916-77d1-4f1a-a38d-9927d85d5b23 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:12.406095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-265d0161-92f6-4f32-b7b6-ac816b775656 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1222 microversion: 2.1 time: 0.402986 Aug 31 19:25:12.407333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 14/30] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:12 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1222 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:12.440907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-9b220916-77d1-4f1a-a38d-9927d85d5b23 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for user 0d5336bcea514f378e06737680ae9bdc and project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:12.441537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b813b1fb-1a2f-4fbc-81d7-177f0bcbeb77 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:12.445095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b813b1fb-1a2f-4fbc-81d7-177f0bcbeb77 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:12.572626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b813b1fb-1a2f-4fbc-81d7-177f0bcbeb77 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:12.591347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b813b1fb-1a2f-4fbc-81d7-177f0bcbeb77 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1215 microversion: 2.1 time: 0.181504 Aug 31 19:25:12.592727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9b220916-77d1-4f1a-a38d-9927d85d5b23 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.480924 Aug 31 19:25:12.594292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 17/31] 10.222.0.59 () {62 vars in 1200 bytes} [Wed Aug 31 19:25:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 484 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 19:25:12.601568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-863331a7-4345-427a-84e6-d93da6541088 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc189f70>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:12.604308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 15/32] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:12 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1215 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:12.683384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-863331a7-4345-427a-84e6-d93da6541088 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 200 len: 287 microversion: 2.1 time: 0.085883 Aug 31 19:25:12.688736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 18/33] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:12 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:12.830496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1720505101", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:12.947543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] validate_networks() for [('e413f1b1-2e66-4271-87c8-7a5825a65e8e', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:25:13.628498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-98e912e2-2918-49eb-9249-2c0858613460 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:13.629095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-98e912e2-2918-49eb-9249-2c0858613460 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:14.054598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-98e912e2-2918-49eb-9249-2c0858613460 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:14.100210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-98e912e2-2918-49eb-9249-2c0858613460 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1215 microversion: 2.1 time: 0.478068 Aug 31 19:25:14.108094 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 19/34] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:13 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1215 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:14.127786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cd2f0cc5-0eb7-4969-87cf-98b87d72db97 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cb93fdc0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:14.192076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-cd2f0cc5-0eb7-4969-87cf-98b87d72db97 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] HTTP exception thrown: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cd2f0cc5-0eb7-4969-87cf-98b87d72db97 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Request method failure captured: Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e HTTP/1.1 Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WF_A0P6eYIWQVbBEyQ2XThPJWRGIHgkUU0LCMw0hBo-3oseyQZ_Vuh5TcvojenW9kagXJdPS8cDY9cxu2RILCjA2j1OoK7K8ddmejyVoRBDue3O1LHvZLdKrd70-MnWSvJDkYJgRIFjkJfw6RGnlTI1sxVUjema1DMWyl-weYBnkM Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:25:14.195017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b035a36532cd45689246f990030a3a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b035a36532cd45689246f990030a3a76", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 6b94b7297d0f4676a6272ea0c6e99895 Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'e70ffe96-8f21-496e-9264-f8a139a6386e'} Aug 31 19:25:14.196401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. (HTTP 404) (Request-ID: req-e9ec50ae-7931-41f4-9d01-d6c9707813b4) Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.197279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:14.198374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 19:25:14.199553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. Aug 31 19:25:14.200704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:14.203192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cd2f0cc5-0eb7-4969-87cf-98b87d72db97 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Returning 404 to user: Snapshot e70ffe96-8f21-496e-9264-f8a139a6386e could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:14.209789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cd2f0cc5-0eb7-4969-87cf-98b87d72db97 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e" status: 404 len: 111 microversion: 2.1 time: 0.095222 Aug 31 19:25:14.209789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 20/35] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 31 19:25:14 2022] GET /compute/v2.1/os-snapshots/e70ffe96-8f21-496e-9264-f8a139a6386e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:14.218434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3ecbb2ae-aad7-4724-90d6-1cfdc0d2d74c tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cc278e50>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:14.276146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:25:14.276712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:25:14.277961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:25:14.278746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:25:14.280494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:25:14.298805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.299388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.299749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.302727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:14.303401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:14.304025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:14.369524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:14.375547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for user d441bbdb43c5403abf8480146bc15753 and project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:14.406004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:25:14.411545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:25:14.437333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3ecbb2ae-aad7-4724-90d6-1cfdc0d2d74c tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 202 len: 0 microversion: 2.1 time: 0.226347 Aug 31 19:25:14.441525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 21/36] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:25:14 2022] DELETE /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:25:14.448532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-963027bc-27d0-4243-9f4d-cbd7c5b1b823 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cb8d0940>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:14.565949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-963027bc-27d0-4243-9f4d-cbd7c5b1b823 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 200 len: 344 microversion: 2.1 time: 0.122391 Aug 31 19:25:14.568759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 22/37] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:14 2022] GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:14.680670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6c2af840-2221-4e21-a34f-0b297bb32169 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.855693 Aug 31 19:25:14.685060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 16/38] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:25:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:25:14.698037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2c27433a-0d4b-4f09-a308-dc83a1012ea6 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:14.699383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2c27433a-0d4b-4f09-a308-dc83a1012ea6 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:14.914569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2c27433a-0d4b-4f09-a308-dc83a1012ea6 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:14.939379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2c27433a-0d4b-4f09-a308-dc83a1012ea6 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1222 microversion: 2.1 time: 0.240013 Aug 31 19:25:14.953864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 23/39] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:14 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:15.129354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.129985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:15.144347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:15.144955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:15.145353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:15.146080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:15.146553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:15.147025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:15.582030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-73330c4e-69fc-4b45-b08e-f0f7b4cbf491 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cb8e1430>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.625863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-73330c4e-69fc-4b45-b08e-f0f7b4cbf491 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] HTTP exception thrown: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-73330c4e-69fc-4b45-b08e-f0f7b4cbf491 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Request method failure captured: Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac HTTP/1.1 Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WF_A0P6eYIWQVbBEyQ2XThPJWRGIHgkUU0LCMw0hBo-3oseyQZ_Vuh5TcvojenW9kagXJdPS8cDY9cxu2RILCjA2j1OoK7K8ddmejyVoRBDue3O1LHvZLdKrd70-MnWSvJDkYJgRIFjkJfw6RGnlTI1sxVUjema1DMWyl-weYBnkM Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:25:15.628461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b035a36532cd45689246f990030a3a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b035a36532cd45689246f990030a3a76", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 6b94b7297d0f4676a6272ea0c6e99895 Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'a6198760-46ab-47f6-8a75-59988fcc15ac'} Aug 31 19:25:15.629862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. (HTTP 404) (Request-ID: req-2e1c08a8-577a-44d7-9012-cc758cda58e9) Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.630691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:15.632188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:25:15.633656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.634915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.639961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-73330c4e-69fc-4b45-b08e-f0f7b4cbf491 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Returning 404 to user: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:15.642187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-73330c4e-69fc-4b45-b08e-f0f7b4cbf491 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 404 len: 109 microversion: 2.1 time: 0.066739 Aug 31 19:25:15.643359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 24/40] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:15 2022] GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:25:15.659763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e779258-3c72-4238-9ce6-ca789acc1081 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cb8d0ee0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.735193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-6e779258-3c72-4238-9ce6-ca789acc1081 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] HTTP exception thrown: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e779258-3c72-4238-9ce6-ca789acc1081 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Request method failure captured: Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac HTTP/1.1 Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WF_A0P6eYIWQVbBEyQ2XThPJWRGIHgkUU0LCMw0hBo-3oseyQZ_Vuh5TcvojenW9kagXJdPS8cDY9cxu2RILCjA2j1OoK7K8ddmejyVoRBDue3O1LHvZLdKrd70-MnWSvJDkYJgRIFjkJfw6RGnlTI1sxVUjema1DMWyl-weYBnkM Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:25:15.737266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b035a36532cd45689246f990030a3a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b035a36532cd45689246f990030a3a76", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 6b94b7297d0f4676a6272ea0c6e99895 Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'a6198760-46ab-47f6-8a75-59988fcc15ac'} Aug 31 19:25:15.738614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. (HTTP 404) (Request-ID: req-c2758329-a9a4-4a14-bbd7-208aac461f78) Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.739592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:25:15.740897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:25:15.743031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e779258-3c72-4238-9ce6-ca789acc1081 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Returning 404 to user: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e779258-3c72-4238-9ce6-ca789acc1081 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 404 len: 109 microversion: 2.1 time: 0.090230 Aug 31 19:25:15.744603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 25/41] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:25:15 2022] DELETE /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:25:15.753421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-34c04c06-9818-471b-a2b4-c2798942d9b3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Calling method '.version_select at 0x7ff6cb8e1e50>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.827679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-34c04c06-9818-471b-a2b4-c2798942d9b3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] HTTP exception thrown: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-34c04c06-9818-471b-a2b4-c2798942d9b3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Request method failure captured: Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac HTTP/1.1 Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WF_A0P6eYIWQVbBEyQ2XThPJWRGIHgkUU0LCMw0hBo-3oseyQZ_Vuh5TcvojenW9kagXJdPS8cDY9cxu2RILCjA2j1OoK7K8ddmejyVoRBDue3O1LHvZLdKrd70-MnWSvJDkYJgRIFjkJfw6RGnlTI1sxVUjema1DMWyl-weYBnkM Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:25:15.829606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b035a36532cd45689246f990030a3a76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b035a36532cd45689246f990030a3a76"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b035a36532cd45689246f990030a3a76", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b035a36532cd45689246f990030a3a76 Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-379440553 Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 6b94b7297d0f4676a6272ea0c6e99895 Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesSnapshotsTestJSON-379440553-project Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'a6198760-46ab-47f6-8a75-59988fcc15ac'} Aug 31 19:25:15.830942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. (HTTP 404) (Request-ID: req-6332eb29-e4e0-4b16-855a-647dfa0d1dd6) Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.832048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:25:15.833229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:25:15.834526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-34c04c06-9818-471b-a2b4-c2798942d9b3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] Returning 404 to user: Volume a6198760-46ab-47f6-8a75-59988fcc15ac could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-34c04c06-9818-471b-a2b4-c2798942d9b3 tempest-VolumesSnapshotsTestJSON-379440553 tempest-VolumesSnapshotsTestJSON-379440553-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac" status: 404 len: 109 microversion: 2.1 time: 0.081929 Aug 31 19:25:15.835710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 26/42] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:15 2022] GET /compute/v2.1/os-volumes/a6198760-46ab-47f6-8a75-59988fcc15ac => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:25:15.962683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e7986f3-0410-4bcd-93e2-cc22e37d86ef tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:15.963502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6e7986f3-0410-4bcd-93e2-cc22e37d86ef tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:16.184388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6e7986f3-0410-4bcd-93e2-cc22e37d86ef tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:16.195590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e7986f3-0410-4bcd-93e2-cc22e37d86ef tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1222 microversion: 2.1 time: 0.236929 Aug 31 19:25:16.196180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 27/43] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:15 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:16.300355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:16.352325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-37eda0bc-88bf-45a4-873d-388250d36c0b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1219 microversion: 2.1 time: 1.226964 Aug 31 19:25:16.353980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 17/44] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:15 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1219 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:17.223088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:17.223716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:17.234121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.234901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.238597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.239591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.240685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.241623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.377618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:17.378246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:17.390781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.393746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.397125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.397125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:17.397125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:17.397125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:17.535626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:17.555156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:17.562514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8dca7489-8772-48ca-bcac-2e1bfdd0956e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1218 microversion: 2.1 time: 0.344695 Aug 31 19:25:17.563128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 28/45] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:17 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1218 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:17.566251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-25b484e2-ee1e-4cf7-a494-5b864c123c9e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1267 microversion: 2.1 time: 0.192233 Aug 31 19:25:17.567240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 18/46] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:17 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:17.787444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1841459042", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e255a1b-52c7-4e9a-bc8b-eb98a8191098"}], "security_groups": [{"name": "tempest-securitygroup--531485370"}], "key_name": "tempest-keypair-710140689", "user_data": "}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:17.926741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] validate_networks() for [('0e255a1b-52c7-4e9a-bc8b-eb98a8191098', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:25:18.204301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2135578718", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2905708-4aef-4255-8fe7-eac971d81d06"}], "security_groups": [{"name": "tempest-securitygroup--1318337232"}], "key_name": "tempest-keypair-1753768347", "user_data": "}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:18.476565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] validate_networks() for [('c2905708-4aef-4255-8fe7-eac971d81d06', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:25:18.564928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:25:18.566942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:25:18.567593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:25:18.568454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:25:18.569196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:25:18.586052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.586982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.588987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.590117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.591498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.592248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.621469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for project a13c903a376b46508e8cccbcb20b484c. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:18.628646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for user 8bc4801f1f674f55b57d49e5f09205ea and project a13c903a376b46508e8cccbcb20b484c. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:18.646660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:25:18.650030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:25:18.820364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f9e0781b-adc4-4d26-8cdf-2043e6f05066 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.037644 Aug 31 19:25:18.828058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 29/47] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:25:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:25:18.847590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:18.850028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:18.870700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.871462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.873033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:18.877639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:18.878581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:18.879301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.126993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:25:19.127663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:25:19.130662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:25:19.131131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:25:19.138922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:25:19.143353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.144037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.145120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.148385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.161619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.162368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.185545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.205877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-00d03bfd-96db-49bb-a4ef-87daeaf86fa5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1218 microversion: 2.1 time: 0.367236 Aug 31 19:25:19.205877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 30/48] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:18 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1218 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:19.205877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:19.205877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:19.210670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:25:19.221997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.222517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.223532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for user 0d5336bcea514f378e06737680ae9bdc and project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:25:19.226022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.228590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:19.236138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:19.236138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:19.248534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:25:19.251195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:25:19.360760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.381768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-84187b4b-c651-4a2f-ba9a-ded1efdff5f7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1267 microversion: 2.1 time: 0.179894 Aug 31 19:25:19.391061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 31/49] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:19 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:19.396417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f8ea6366-25f9-492f-9fd7-1400c38c7e2e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:19.397230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f8ea6366-25f9-492f-9fd7-1400c38c7e2e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:19.475747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f5552322-24b3-4c0c-a48e-613495d07c40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.292349 Aug 31 19:25:19.484647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f8ea6366-25f9-492f-9fd7-1400c38c7e2e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.490537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 19/50] 10.222.0.59 () {62 vars in 1188 bytes} [Wed Aug 31 19:25:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 19:25:19.506540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f8ea6366-25f9-492f-9fd7-1400c38c7e2e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1237 microversion: 2.1 time: 0.114064 Aug 31 19:25:19.507339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 32/51] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:19 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:19.527776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d15708f4-9985-4566-80ed-122204d97408 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:19.527776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d15708f4-9985-4566-80ed-122204d97408 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:19.703486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d15708f4-9985-4566-80ed-122204d97408 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.720426 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d15708f4-9985-4566-80ed-122204d97408 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.728633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d15708f4-9985-4566-80ed-122204d97408 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:19.734514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d15708f4-9985-4566-80ed-122204d97408 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1282 microversion: 2.20 time: 0.227218 Aug 31 19:25:19.739244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 20/52] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:19 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:20.239764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.242313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.266315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.266315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.266315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.267829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.268989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.299386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.404580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.409417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.415235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.416060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.416630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.417443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.418134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.418664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.537380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.552881 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.563596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-61a4269d-e34f-4626-8e7a-e465a24f0815 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1267 microversion: 2.1 time: 0.162963 Aug 31 19:25:20.565081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 21/53] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:20 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:20.575492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.576944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.580452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1785f70c-0e18-48a8-9fc5-8801497ed2ac tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1218 microversion: 2.1 time: 0.337290 Aug 31 19:25:20.593288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 33/54] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:20 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:20.593536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.593536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.593536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.593536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:20.594087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:20.594087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:20.747319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.759400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4c82863c-20f6-4b78-8343-7dd9ae2650f8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1241 microversion: 2.1 time: 0.192408 Aug 31 19:25:20.770126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2a95915a-8876-46fe-b6df-55bf562ff6fb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:20.771158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2a95915a-8876-46fe-b6df-55bf562ff6fb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:20.772194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 22/55] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:20 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:20.852869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a95915a-8876-46fe-b6df-55bf562ff6fb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.866003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a95915a-8876-46fe-b6df-55bf562ff6fb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.873416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a95915a-8876-46fe-b6df-55bf562ff6fb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:20.873416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2a95915a-8876-46fe-b6df-55bf562ff6fb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1282 microversion: 2.20 time: 0.104589 Aug 31 19:25:20.873416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 34/56] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:20 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:21.604494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:21.605790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:21.609597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:21.615185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.616337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.621094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:21.621094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.621094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.621094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:21.628085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:21.644734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.650806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.654992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:21.654992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.654992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.655968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:21.814658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:21.829010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cbf5007b-5f03-40df-8333-d042ab727e49 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1274 microversion: 2.1 time: 0.231173 Aug 31 19:25:21.833547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 23/57] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:21 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:21.845184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:21.846675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:21.856562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.857612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.858263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:21.860293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:21.860293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:21.860293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.056719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.085918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-41d862c4-300d-49a0-8374-45dc22fa4a61 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1233 microversion: 2.1 time: 0.251009 Aug 31 19:25:22.099793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 24/58] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:21 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1233 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:22.107493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:22.109368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:22.116626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.117370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.118061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.119020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.119705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.120478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.134149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.166247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-60a3b67b-72f2-4181-ae2b-3ee29b39aaea tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1285 microversion: 2.1 time: 0.562940 Aug 31 19:25:22.184266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 35/59] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:21 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1285 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:22.192326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.212775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.225355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:22.227830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-24674c6a-7b30-4f97-9814-2fdfc86220ef tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1278 microversion: 2.20 time: 0.126786 Aug 31 19:25:22.229410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 25/60] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:22 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:22.853968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:22.854589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:22.882458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.883097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.883546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:22.888622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:22.894669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:22.899323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.109788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f6f8aca3-94c9-4c9e-8489-6ea217ebb0e7 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb862d30>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:23.670712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:23.681713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-45799743-a875-427a-98f7-933849b82c84 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1280 microversion: 2.1 time: 0.831797 Aug 31 19:25:23.698345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 36/61] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:22 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1280 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:23.705930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:23.707614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:23.714974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.716962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.717563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.718862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.719510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.720097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.734245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f6f8aca3-94c9-4c9e-8489-6ea217ebb0e7 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/f00e5d6d-9419-4327-8b4a-fe85aa64951b" status: 200 len: 351 microversion: 2.1 time: 0.630448 Aug 31 19:25:23.743219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 26/62] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:23 2022] GET /compute/v2.1/os-volumes/f00e5d6d-9419-4327-8b4a-fe85aa64951b => generated 351 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:23.751166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:23.751790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:23.779965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.780470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.780917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.781626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.782083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.782510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.898231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:23.910733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4237ca0f-3e7b-4914-bcb7-c9958f76cdb5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1273 microversion: 2.1 time: 0.165906 Aug 31 19:25:23.925266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 27/63] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:23 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:23.933111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:23.934087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:23.943365 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.944618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.945225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:23.946667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:23.947425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:23.947931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.065796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:24.079189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5398f02a-38fe-47f9-990a-326c4f8fd00f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1297 microversion: 2.1 time: 0.376374 Aug 31 19:25:24.079777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 37/64] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:23 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1297 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:24.193941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:24.213166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:24.220283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:24.221451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e94d1e78-0104-4741-b7f0-cbccdec98679 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1334 microversion: 2.20 time: 0.294950 Aug 31 19:25:24.222236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 28/65] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:23 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1334 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:24.707637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:24.708556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:24.729614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.730317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.731169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.733029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.733817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.734463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.937486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:24.938406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:24.945955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.957986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.958640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:24.959610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:24.960073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:24.960526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.284803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:25.307623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f3599c9a-7cf0-43b7-85ac-e1b575377d59 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.603165 Aug 31 19:25:25.311312 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 38/66] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:24 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:25.336115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:25.337265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:25.397116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.400918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.401664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.402786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.403524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.404353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.913032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:25.936032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1771ae08-8241-48b8-9e05-e0e83cee285e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1295 microversion: 2.1 time: 0.620033 Aug 31 19:25:25.938011 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 39/67] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:25 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1295 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:25.942987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:25.943595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:25.953498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.957739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.957739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:25.957739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:25.958586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:25.959229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.167818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:26.178661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-faa1e501-bab0-47c3-b0ad-f69d41689203 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 1.245932 Aug 31 19:25:26.180718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 29/68] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:24 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:26.335067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:26.336110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:26.351626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.353469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.354238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.356654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.359417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.360156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.417863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:26.436821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:26.440878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:26.454953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e9af6e1f-6b79-492b-84c9-e6b8917691c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1340 microversion: 2.20 time: 0.514520 Aug 31 19:25:26.454953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 40/69] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:25 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1340 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:26.962982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:26.966753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:26.974062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.975798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.977428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:26.982623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:26.983290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:26.984803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.349282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:27.359563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b563ce44-d04b-44f2-8739-22eed0ee197c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1295 microversion: 2.1 time: 0.400426 Aug 31 19:25:27.366192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 41/70] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:26 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1295 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:27.510314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9a1dbe-59be-491e-a129-aba5a3e1fe39", "tag": "945cd1b7-9a64-4d73-ab52-f3396a055dc3"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:27.527173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.527652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.528251 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.555382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Creating event network-changed:945cd1b7-9a64-4d73-ab52-f3396a055dc3 for instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 on hv-cinder-85220 Aug 31 19:25:27.556338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 19:25:27.557139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-85fcefc4-a8cc-4426-95f0-beedb733619b req-97e01978-d9ad-4607-8405-88ee7350321d service nova] Acquired lock "compute-rpcapi-router" {{(pid=121186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 19:25:27.558694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.559537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.560275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.561320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.562157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.563106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.583794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.compute.rpcapi [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 19:25:27.589113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] Releasing lock "compute-rpcapi-router" {{(pid=121186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 19:25:27.621844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:27.631217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-335a8c34-492b-4ba7-873c-fe6cd8d77e75 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263282 Aug 31 19:25:27.632109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 42/71] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:27.636396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-caa652f2-d62a-4a81-8627-e8ec162325f2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 1.306297 Aug 31 19:25:27.637753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 30/72] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:26 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:27.639579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:27.642832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:27.661168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.661672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.662108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.669305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.670556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.671580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.677315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:27.677315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:27.681880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.683264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.683973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:27.686744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:27.688167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:27.688891 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.170578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.197895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.203493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.204163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-81da01fe-60a1-4259-a764-6aa3935e3e70 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1340 microversion: 2.20 time: 0.564573 Aug 31 19:25:28.212786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 31/73] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:27 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1340 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:28.239054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9bc26412-add6-40fb-86c3-541ce2155ae4 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8b09d0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:28.344170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9bc26412-add6-40fb-86c3-541ce2155ae4 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3f27e88e-6676-4f56-88e0-7fc9367d68b3" status: 200 len: 351 microversion: 2.1 time: 0.129022 Aug 31 19:25:28.345389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 32/74] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:28 2022] GET /compute/v2.1/os-volumes/3f27e88e-6676-4f56-88e0-7fc9367d68b3 => generated 351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:28.410142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:28.414169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:28.434497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:28.444989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.447340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.449833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.453338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.455399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.458023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.468759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.494091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9c9e8e51-33ce-4d6c-a64b-e0352886f498 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.853693 Aug 31 19:25:28.494091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 43/75] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:27 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:28.659923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:28.661571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:28.671126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:28.672857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.673780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.680775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.682075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:28.682708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b16f517c-c235-413c-abd5-354b1f2e3d37 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1295 microversion: 2.1 time: 0.292217 Aug 31 19:25:28.684177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:28.685535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:28.686441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 33/76] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:28 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1295 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:29.241305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:29.242022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:29.296179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:29.297875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.298375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.298796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.306570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.307179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.307803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.487709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.507731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.509772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ad4be9b0-b1ee-4e1e-b53f-e7b36f6cf86e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.855517 Aug 31 19:25:29.518142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.519215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 44/77] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:28 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:29.524994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:29.527768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ede564c4-cc4d-40bf-a00f-142c947ad9c4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1340 microversion: 2.20 time: 0.293169 Aug 31 19:25:29.535481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 34/78] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:29 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1340 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:29.539113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:29.539943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:29.552337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.552880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.553521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.554205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.554662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.555269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.713204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:29.713823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:29.719003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=28 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:29.744762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.745401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.745857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:29.748663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:29.749146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:29.749580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.398752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.411932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b93fdb4e-b313-4ebe-bef0-5500a5487d88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.891541 Aug 31 19:25:30.429519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 45/79] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:29 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:30.441245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.461922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1729340c-db7b-4cc7-9566-ff968801dd90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.747879 Aug 31 19:25:30.475317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 35/80] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:29 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:30.475625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-189bdfec-ee9c-4383-b07b-95126dc9393a req-179629ca-1fb7-462e-8d7d-18d40473e29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04777b04-7baf-471b-a244-e91bc64cb15b", "tag": "fedebd72-d0d8-4183-bb59-913256ef56e7"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:30.502700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-189bdfec-ee9c-4383-b07b-95126dc9393a req-179629ca-1fb7-462e-8d7d-18d40473e29b service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.506113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-189bdfec-ee9c-4383-b07b-95126dc9393a req-179629ca-1fb7-462e-8d7d-18d40473e29b service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.506714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-189bdfec-ee9c-4383-b07b-95126dc9393a req-179629ca-1fb7-462e-8d7d-18d40473e29b service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.536368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:30.537256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:30.553642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-189bdfec-ee9c-4383-b07b-95126dc9393a req-179629ca-1fb7-462e-8d7d-18d40473e29b service nova] Creating event network-changed:fedebd72-d0d8-4183-bb59-913256ef56e7 for instance 04777b04-7baf-471b-a244-e91bc64cb15b on hv-cinder-85220 Aug 31 19:25:30.564296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.570612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.573132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.573974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.574455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.577998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-189bdfec-ee9c-4383-b07b-95126dc9393a req-179629ca-1fb7-462e-8d7d-18d40473e29b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155475 Aug 31 19:25:30.578308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.578962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 46/81] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:30.587332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:30.591833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:30.605001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:30.609097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.635498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.635498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.635498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:30.635498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:30.645829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:30.650436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:30.864828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=26 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:30.901989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.907245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:30.913238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.917738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:30.917738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2c15ed1a-9189-4bfd-887f-fe046ffeb562 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.336005 Aug 31 19:25:30.917738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 47/82] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:30 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:31.116396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-dd8cb115-6446-4064-a39f-d5067123db88 req-a5f25b33-64d9-4e4f-95ba-cdb9ac46ea93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d920f4b-fb26-4da7-a545-49ccbc5fcaff", "tag": "f411081e-0621-4211-b73b-5d11871d58bb"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:31.128618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-dd8cb115-6446-4064-a39f-d5067123db88 req-a5f25b33-64d9-4e4f-95ba-cdb9ac46ea93 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.129304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-dd8cb115-6446-4064-a39f-d5067123db88 req-a5f25b33-64d9-4e4f-95ba-cdb9ac46ea93 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.129992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-dd8cb115-6446-4064-a39f-d5067123db88 req-a5f25b33-64d9-4e4f-95ba-cdb9ac46ea93 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.151680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-dd8cb115-6446-4064-a39f-d5067123db88 req-a5f25b33-64d9-4e4f-95ba-cdb9ac46ea93 service nova] Creating event network-changed:f411081e-0621-4211-b73b-5d11871d58bb for instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff on hv-cinder-85220 Aug 31 19:25:31.159341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-dd8cb115-6446-4064-a39f-d5067123db88 req-a5f25b33-64d9-4e4f-95ba-cdb9ac46ea93 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241204 Aug 31 19:25:31.161009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 48/83] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:31.437689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.439394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.453245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.462148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.463065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.464095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.476385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.476385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.750455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.764327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e0f1ae01-6340-4ca2-b069-38da5a2b6c46 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.329989 Aug 31 19:25:31.765538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 49/84] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:31.781039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.783604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:31.797584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.797584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.797584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.797584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:31.797923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:31.797923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:31.855482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:31.878486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d29c4475-7fce-46ec-a601-0094c6c85866 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 1.336497 Aug 31 19:25:31.883019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 36/85] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:30 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:31.895266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-495f308f-4446-4fde-bef2-c1fee62fc2c3 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8a4550>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:31.993476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-495f308f-4446-4fde-bef2-c1fee62fc2c3 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/53839466-cf76-4f81-82e1-3053ad7a3389" status: 200 len: 350 microversion: 2.1 time: 0.108911 Aug 31 19:25:31.994061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 37/86] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/os-volumes/53839466-cf76-4f81-82e1-3053ad7a3389 => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:32.001014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.002503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:32.037059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.037478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.037956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.039383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.040373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.041293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.096728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:32.117517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c70833cf-7e45-41f3-b45e-04f33c35073e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.344204 Aug 31 19:25:32.118089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 50/87] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:32.162956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-672248e8-163d-4e4e-81a0-37d04d330836 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8e1790>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.344029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-672248e8-163d-4e4e-81a0-37d04d330836 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213205 Aug 31 19:25:32.345207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 51/88] 10.222.0.59 () {58 vars in 1134 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:32.360830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b8dd0333-cd4c-470c-8325-e9738511028d tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb7ce3a0>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.406018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:32.425280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:32.426735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:32.427926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c1312cd6-0808-4738-96b1-9136cd4eefbd tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.432841 Aug 31 19:25:32.428493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 38/89] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:31 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:32.632764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b8dd0333-cd4c-470c-8325-e9738511028d tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.277951 Aug 31 19:25:32.642537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 52/90] 10.222.0.59 () {58 vars in 1149 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:32.646808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-215a9890-bcda-4298-9847-1836e3cf60d9 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8a4940>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.788840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.789463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:32.796103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-215a9890-bcda-4298-9847-1836e3cf60d9 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.153015 Aug 31 19:25:32.804612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.804612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.808261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.808389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 39/91] 10.222.0.59 () {58 vars in 1134 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:32.808481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.808995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.810411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.818331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c1394547-c9bc-40b1-a6b0-f605563b90bc tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8623a0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.957043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c1394547-c9bc-40b1-a6b0-f605563b90bc tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150235 Aug 31 19:25:32.972329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 40/92] 10.222.0.59 () {58 vars in 1167 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:32.982668 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:32.983449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:32.994061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.994608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.995091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:32.995926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:32.996388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:32.996896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.062822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.073182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d4d4f16d-86e9-4b63-9d45-79a95c4d3580 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.291192 Aug 31 19:25:33.076921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 53/93] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:33.085402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d5216146-ad7e-40d9-838d-cfa4f00f3190 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb7ce790>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.207666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.214184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d5216146-ad7e-40d9-838d-cfa4f00f3190 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.135693 Aug 31 19:25:33.214972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 54/94] 10.222.0.59 () {58 vars in 1170 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:33.218117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fec31f2b-b6e4-443c-912e-8c6d7a7614c8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.244640 Aug 31 19:25:33.219187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 41/95] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:32 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:33.226136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf99492-1198-453d-9f3b-f4f8bdbc225a", "tag": "531806c1-a1f4-449c-a1b4-ec4835b2b388"}, {"name": "network-changed", "server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:33.235936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.237339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:33.241705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.242195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.242632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.245502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.245502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.245502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.245502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.245823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.246207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.267363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Creating event network-changed:531806c1-a1f4-449c-a1b4-ec4835b2b388 for instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a on hv-cinder-85220 Aug 31 19:25:33.268365 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Creating event network-changed:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:25:33.269202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 19:25:33.269864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a8165973-f55a-4b2f-830b-bfc7d4220466 req-607eb297-bbdb-42f9-be1b-ab032d82b207 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 19:25:33.271434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.276077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.276077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.276077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.276077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.276077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.292255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.compute.rpcapi [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 19:25:33.293167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] Releasing lock "compute-rpcapi-router" {{(pid=121187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 19:25:33.314095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e18a29f0-1669-4691-ad15-9a2b2e298210 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.093460 Aug 31 19:25:33.314991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 42/96] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:33.321389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1ec81229-29f5-4d3d-b7bc-ad7eac301aa6 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8a4dc0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.423418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1ec81229-29f5-4d3d-b7bc-ad7eac301aa6 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.106591 Aug 31 19:25:33.425455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 43/97] 10.222.0.59 () {58 vars in 1155 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:33.446023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4b8cbf35-a6ca-4bec-b444-55b460d95674 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb8620d0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.572292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4b8cbf35-a6ca-4bec-b444-55b460d95674 tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.137651 Aug 31 19:25:33.582242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 44/98] 10.222.0.59 () {58 vars in 1188 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:25:33.582242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.584960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:33.596358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.596856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.597487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.598667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:33.599161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:33.599610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:33.731303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:33.743842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-905fa762-a294-41aa-85a1-110baa3e8712 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.527516 Aug 31 19:25:33.749156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 55/99] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:33.756247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a1f8aed4-a3e4-430a-b608-b6afd3f0918a tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] Calling method '.version_select at 0x7ff6cb7ce280>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:33.889383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a1f8aed4-a3e4-430a-b608-b6afd3f0918a tempest-VolumesTestJSON-1859427832 tempest-VolumesTestJSON-1859427832-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.138919 Aug 31 19:25:33.890452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 56/100] 10.222.0.59 () {58 vars in 1155 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:34.100457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:34.101216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:34.126335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.127038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.127676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.128718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.129279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.129770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.218479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.228741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.231689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.239666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f9d746fc-5ff2-4e36-83a3-8bcab2e284b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.664782 Aug 31 19:25:34.258774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 45/101] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:33 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:34.267397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:34.268240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:34.275198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.276510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.279347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.280657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.281393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.282240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.847277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:34.865933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9eeda0bc-d4e6-4310-a890-089187795c31 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.768328 Aug 31 19:25:34.877180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 57/102] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:34 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:34.886753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:34.888529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:34.897521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.898215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.898810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:34.899943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:34.900597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:34.901218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.171859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:35.184913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bd91c90a-93dd-4613-835f-9f7b4d8af79e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.923366 Aug 31 19:25:35.186066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 46/103] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:34 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:35.275568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:35.278820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:35.286180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.286997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.288251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.289336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.289980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.290704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.373983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:35.387576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8e503c73-70e0-4b03-b61c-3d8f75aa3162 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.505196 Aug 31 19:25:35.388871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 58/104] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:34 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:35.827551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:35.836468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:35.845189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:35.848953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8c6ae25f-0cf2-4443-96ef-4855e47c4c12 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.583797 Aug 31 19:25:35.886797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 47/105] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:35 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:35.892852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:35.893651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:35.900213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.900998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.901599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:35.902468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:35.903143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:35.904271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:36.149331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:36.161196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-24763bd9-0765-4d43-92e8-c90e6e9a7c56 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.273068 Aug 31 19:25:36.177740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 59/106] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:35 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:36.207100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:36.208137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:36.218945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:36.219854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:36.220671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:36.223393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:36.224063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:36.226331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:36.413973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:36.418054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:36.425406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:36.427451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:36.428122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:36.430138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:36.430619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:36.432644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:36.439074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:36.447380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c9aebb68-15d0-4871-9eb8-f5bdc656a6da tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.245359 Aug 31 19:25:36.448646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 48/107] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:36 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:36.580478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:36.588416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b6839ad8-5613-4f29-8830-e4356ce5c6ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.178673 Aug 31 19:25:36.588976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 60/108] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:36 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:36.900403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:36.905446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:36.907258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:36.907742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:36.908176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:36.908871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:36.909324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:36.909744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.052254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.062382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.064730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.066204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04541509-4eca-49b4-b1eb-3e3bbe2108f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.169776 Aug 31 19:25:37.066991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 49/109] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:36 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:37.188448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:37.189274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:37.196916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.197434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.197880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.198589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.199150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.199587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.342720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.350742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6d30e485-6c97-4c25-bf31-5e10b437dfc1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.167797 Aug 31 19:25:37.355365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 61/110] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:37 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:37.470372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:37.471012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:37.477496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.477984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.478425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.479152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.479605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.480029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.611025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:37.611535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:37.612700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.614600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:37.618204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.618722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.619177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.619885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:37.620519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:37.621041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-109423c0-efbd-435f-8f35-ad924ab52c73 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.155201 Aug 31 19:25:37.621382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:37.621619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 50/111] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:37 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:37.752520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:37.760341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0ae8d410-3aab-45c4-befb-9282ab1f381e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.154568 Aug 31 19:25:37.760900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 62/112] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:37 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:38.088811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:38.094440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:38.097685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.098769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.098769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.099467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.099921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.100346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.372446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:38.373685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:38.380275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.380768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.381199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.382078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.382538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.383109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.385764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.397243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.398699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.400512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-28e390ab-fc04-40da-8b0d-f1e0bd377a21 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.315127 Aug 31 19:25:38.413131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 51/113] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:38 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:38.538764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.547941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a3a446b3-14cf-4e67-b3df-1ff108cff08a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.179349 Aug 31 19:25:38.548524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 63/114] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:38 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:38.643362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:38.643896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:38.649844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.653841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.653841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.653841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.653841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.654227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.782236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:38.782854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:38.783128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.789024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.789517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.789960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.791145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-76b0a4ad-4713-43ea-a327-24f0448b9591 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.151625 Aug 31 19:25:38.803955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:38.804083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 52/115] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:38 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:38.804183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:38.804183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:38.921157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:38.928837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-557bd5e0-efef-4d70-bb36-eb19d6951ee5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.151375 Aug 31 19:25:38.929393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 64/116] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:38 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:39.423655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:39.424269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:39.430801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.431112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.431535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.432245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.432719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.433392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.564074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:39.572663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:39.573668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:39.574105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:39.575889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:39.578319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-35aea20e-a96c-49ea-b587-b95771d3a555 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.159399 Aug 31 19:25:39.585370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 53/117] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:39 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:39.585538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.585538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.585538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.585538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.585849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.585849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.714541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:39.723577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-24d2ec5b-48b2-48b9-95d7-35be7d0eb2b2 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.157819 Aug 31 19:25:39.724379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 65/118] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:39 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:39.814036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:39.814654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:39.820738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.821226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.821681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.822378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.822856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.823321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.952442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:39.953399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:39.962642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.963100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.963554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:39.966696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:39.966696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:39.966696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:40.007660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.016158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3f7ea843-4e75-41ad-bfca-95f0d1dce142 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.206452 Aug 31 19:25:40.016742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 54/119] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:39 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:40.101105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.109167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ba903184-11b5-4984-b93b-0cea133f110b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.162867 Aug 31 19:25:40.109733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 66/120] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:39 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:40.601225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:40.602503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:40.610829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:40.611439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:40.612273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:40.613000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:40.613462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:40.614066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:40.747931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:40.747931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:40.756786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:40.757523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:40.758169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:40.759121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:40.759930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:40.760554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:40.787078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.795608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.797159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.798274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-150ad6ef-b80f-4aa6-a108-92942943aa5a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.200999 Aug 31 19:25:40.802121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 55/121] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:40 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:40.965358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:40.971036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0094045d-eb68-4276-b7c5-960de0f35409 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.228054 Aug 31 19:25:40.971819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 67/122] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:40 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:41.037704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:41.038275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:41.044206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.044689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.045777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.046494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.046961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.047395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.129889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:41.130752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:41.137664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.137855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.138400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.139274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.140142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.140745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.195045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.204237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9cd57bcf-97a5-444b-83f4-0a39b041d0d8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.170547 Aug 31 19:25:41.204840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 56/123] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:41 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:41.292595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.303005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0581859a-918d-45ef-8a52-da19901dae8b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.177053 Aug 31 19:25:41.303589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 68/124] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:41 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:41.821435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:41.822075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:41.829065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.829601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.830070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.830803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:41.831277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:41.831696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:41.976866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.987868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.989355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:41.990543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3c64f763-1e23-403d-89c4-624e8f5b9880 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.173253 Aug 31 19:25:41.991166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 57/125] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:41 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:41.994195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:41.994891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:42.001351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.001894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.002375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.003131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.003593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.004033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.008361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:42.145027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:42.152658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-607e8cf6-6f0a-4390-b1bf-9cff00e82672 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.164099 Aug 31 19:25:42.153223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 69/126] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:41 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:42.228109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:42.228989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:42.236344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.236870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.237321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.238020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.238499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.239794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.260527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:42.326010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:42.326668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:42.333100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.333588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.334027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.334726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:42.335212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:42.335642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:42.392599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:42.402117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2081f9d1-f0ad-4b1a-a83b-92cd9b2100b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.178052 Aug 31 19:25:42.402717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 58/127] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:42 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:42.471490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:42.479532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-91c8f902-635d-46c8-85fb-5ae1ac0bc51e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.157364 Aug 31 19:25:42.480098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 70/128] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:42 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:43.014411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:43.015124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:43.021417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.021903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.022454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.023271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.023798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.024234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.161626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:43.170693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:43.172228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:43.173808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:43.174427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:43.175998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ed3c7ed8-c71b-447e-8f4f-e7f173d0d55a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.165378 Aug 31 19:25:43.181299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.184257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.184257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.184257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.184257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.184779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.184994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 59/129] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:43 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:43.325653 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:43.338517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-66893ed7-edef-47ed-8e22-51e590406600 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.168746 Aug 31 19:25:43.339221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 71/130] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:43 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:43.424425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:43.429446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:43.429446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:43.431790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.432286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.432723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.433624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.434090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.434523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.505780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:43.505780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:43.521071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.521572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.522012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.522729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:43.523221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:43.523816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:43.582492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:43.591430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-62f8a642-29cb-41eb-84c5-ad213da85d62 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.171980 Aug 31 19:25:43.592019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 60/131] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:43 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:43.661377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:43.676942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a6c3dd51-b6bf-4475-80e2-93c2a9468a58 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.174572 Aug 31 19:25:43.676942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 72/132] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:43 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:44.199241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:44.199847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:44.206503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.207027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.207462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.208169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.208626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.209050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.353620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.361112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:44.361726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:44.362417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.363898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.365002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-279c44bb-8162-44f5-adf7-9e4707decc53 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.169646 Aug 31 19:25:44.365562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 61/133] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:44 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:44.367664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.368172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.368614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.369310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.369767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.370195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.509638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.517076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7cda62a1-d5a3-4354-881f-21b72aed0972 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.160429 Aug 31 19:25:44.517641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 73/134] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:44 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:44.616274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:44.616883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:44.622799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.623366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.623822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.624569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.625353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.625901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.693494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:44.696021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:44.704623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.705418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.706057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.707062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:44.707745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:44.708268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:44.776876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.785521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-54f56c17-c0c9-4f1b-af28-f5a12bb6982f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.173418 Aug 31 19:25:44.786552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 62/135] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:44 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:44.850859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:44.858812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-de97adec-565f-423b-9c9b-9f189fd7b875 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.169899 Aug 31 19:25:44.859409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 74/136] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:44 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:45.387029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:45.387649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:45.393888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.394376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.394998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.395923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.396527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.397335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.537589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.543496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:45.544124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:45.546689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.548198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.549728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9a872f05-0f8b-4310-8f80-e94eb1ca6244 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.167168 Aug 31 19:25:45.550455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 63/137] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:45 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:45.563786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.563786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.563786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.563786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.564995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.564995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.773163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.782334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9ec52f1d-aa5b-4fa1-a6d4-0768450b6ad5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.246365 Aug 31 19:25:45.782838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 75/138] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:45 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:45.806622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:45.808339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:45.813364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.813868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.814340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.815097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.815559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.815988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.879930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:45.880651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:45.886894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.887546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.887886 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.888616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:45.889708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:45.890503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:45.971781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:45.979839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-28bb04f7-4348-4e85-b58d-88ab22af6579 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.176941 Aug 31 19:25:45.980400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 64/139] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:45 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:46.033934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.041944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-41615ec2-e0c2-4d22-a030-1854fca03dab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.166067 Aug 31 19:25:46.042563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 76/140] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:45 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:46.579016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:46.579744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:46.585684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.589002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.589002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.589002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.589002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.589328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.724813 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.733966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.735534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:46.736640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d6609d16-7b4a-48c4-b300-42af7a131d7b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.162416 Aug 31 19:25:46.737194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 65/141] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:46 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:46.803657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:46.807120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:46.810381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.811756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.812305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:46.813016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:46.813476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:46.813904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.001622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:47.002389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:47.008489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.009011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.009463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.010168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.010634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.011165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.014914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:47.023362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-71afe22d-1bd5-4b09-8e4e-8b552ac90b90 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.223373 Aug 31 19:25:47.024285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 77/142] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:46 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:47.064177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:47.064177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:47.073084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.073815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.074349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.075165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.075702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.076240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.153312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:47.161670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6b2839cd-1cd4-48ea-be18-8895f06d1b1b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.165005 Aug 31 19:25:47.166366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 66/143] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:46 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:47.217746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:47.228460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ed28121a-d9f5-4481-a42c-5383d892dc11 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.169714 Aug 31 19:25:47.229412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 78/144] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:47 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:47.759317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:47.759913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:47.766765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.767299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.767737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.768550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:47.769060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:47.769519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:47.909388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:47.917591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:47.919060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:47.920324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c37e4f0e-97e2-4004-87da-81545ad2e136 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.164739 Aug 31 19:25:47.920891 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 67/145] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:47 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:48.045259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:48.046081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:48.052679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.053244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.053756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.054606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.055169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.061140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.183189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:48.183728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:48.190566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.191195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.191654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.192329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.192781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.193236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.195958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:48.215341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e2b6d02e-76ec-4de0-a63c-3082d936a552 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.165814 Aug 31 19:25:48.215341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 79/146] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:48 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:48.253108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:48.257289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:48.271199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.272804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.273654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.274349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.274863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.277413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.348453 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:48.357273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-90d83ffb-7bad-4343-bb44-72c964b5a49f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.177933 Aug 31 19:25:48.358491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 68/147] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:48 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:48.443036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:48.451776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-67e1d358-7ae2-4ff6-b081-95630718e9fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.201833 Aug 31 19:25:48.461119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 80/148] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:48 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:48.942521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:48.948027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:48.949769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.950354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.950975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:48.952331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:48.952484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:48.952989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.084306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.092689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.094169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.095352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-23ebef00-9ffd-4614-8d9f-136c4a831ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.156816 Aug 31 19:25:49.095913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 69/149] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:48 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:49.230757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:49.232749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:49.239258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.239766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.240382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.241212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.241929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.242673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.383321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:49.384014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:49.392716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.393257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.393708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.394421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.394896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.399444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.430226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.440344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ed7af8d4-f19c-4cc9-8972-830fa50d4169 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.214929 Aug 31 19:25:49.440929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 81/150] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:49 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:49.474281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:49.475087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:49.488507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.489091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.489605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.491499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:49.493886 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:49.494398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:49.592544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.601372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d4b3d51a-a805-45d6-b87c-3ab992838e7d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.222553 Aug 31 19:25:49.615405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 70/151] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:49 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:49.654791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:49.662511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fcb0ffd1-2ac1-4f5a-b0a9-47f3e2143de9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.192982 Aug 31 19:25:49.663109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 82/152] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:49 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:50.118325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:50.118962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:50.125287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.125769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.126211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.126916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.127396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.127845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.259538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.267743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.269214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.270316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a1e4b805-f4f4-450a-a2c3-a4dcfacb30bf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.156178 Aug 31 19:25:50.270892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 71/153] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:50 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:50.463874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:50.465330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:50.476028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.477404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.478216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.479589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.481311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.482419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.620766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.623223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:50.623840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:50.629166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6b623d9f-7b94-4168-bc6b-8f4415ff58a6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.170491 Aug 31 19:25:50.631141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 83/154] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:50 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:50.631284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.631284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.631284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.632076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.632548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.632977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.683619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:50.684139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:50.690106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.690598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.691201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.692132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:50.692588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:50.693012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:50.764783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.772867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f44dbc3a-5ae1-4a28-8a4d-f09658aa8de2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.153837 Aug 31 19:25:50.773448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 72/155] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:50 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:50.823425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:50.831678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-291fb6a9-8171-4dbf-9e2e-ce350b7cc1b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.152025 Aug 31 19:25:50.832236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 84/156] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:50 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:51.293620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:51.294237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:51.301858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.302344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.302787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.303643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.304145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.304580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.621403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.629616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.631116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.632225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-45172f9a-03d0-4490-ab42-1e4ea4f6038a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.342600 Aug 31 19:25:51.632787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 73/157] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:51 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:51.650830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:51.651484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:51.658226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.658717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.659197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.659901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.660360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.660792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.787719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.791403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:51.793736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:51.794340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:51.796595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c7c2999f-fd8d-4f8e-9bab-2666a3d68211 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.149564 Aug 31 19:25:51.806010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 85/158] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:51 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:51.806119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.806119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.806119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.806119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.806405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.806405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.852577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:51.853230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:51.859938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.860420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.860851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.861536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:51.861989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:51.862407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:51.937402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:51.946246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-632f02fe-7a1d-4eee-85c6-64f07fb80efe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.156232 Aug 31 19:25:51.946814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 74/159] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:51 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:51.997088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:52.005306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0a0057d9-87a7-4f8e-baf3-de8c371432b9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.156772 Aug 31 19:25:52.005876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 86/160] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:51 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:52.654050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:52.655387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:52.661397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.661872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.662304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:52.663012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.663466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.663887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:52.667852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:52.793939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:52.802169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:52.803648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:52.804748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b12193ad-7c9c-4899-800f-1ecadb6c172f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.154604 Aug 31 19:25:52.805305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 75/161] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:52 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:52.825196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:52.825811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:52.832657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.833147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.833593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:52.834287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.834754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.835215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:52.967464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:52.970514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:52.971423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:52.976769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-03260bef-9eef-43f5-a0b5-9fbd78f6bf7e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.155181 Aug 31 19:25:52.977343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 87/162] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:52 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:52.978069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.978555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.979012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:52.979709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:52.980161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:52.980583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:53.026377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:53.027119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:53.033355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:53.034195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:53.034634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:53.035364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:53.036054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:53.036260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:53.117134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.125550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92fb6003-0232-4056-a656-831b52684a3e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.161623 Aug 31 19:25:53.126488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 76/163] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:52 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:53.176129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.183958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5515057b-ee98-44f6-9f6b-04940df415b7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.161670 Aug 31 19:25:53.184514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 88/164] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:53 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:53.826965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:53.827590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:53.833615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:53.834099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:53.834535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:53.835243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:53.835694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:53.836115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:53.963209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.971788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.973218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:53.974306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6f669c2a-521a-465c-8692-fc71efe527ad tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.151294 Aug 31 19:25:53.974859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 77/165] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:53 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:25:54.002973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.002973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:54.003871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.004356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.004791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.005485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.005941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.006361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.143027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:54.146827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.148935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:54.151369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9d76071e-6720-4d84-bdba-6dc96b2de981 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.158053 Aug 31 19:25:54.151869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 89/166] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:53 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:54.159488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.159995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.160440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.161163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.161657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.162127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.205400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.206104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:54.212128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.212609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.213037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.213793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.214249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.214712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.298933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:54.306729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-891c7da1-6506-4a1d-b382-b31ec914b029 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.163598 Aug 31 19:25:54.307328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 78/167] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:54 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:54.355579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:54.363206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-412d9a75-94e4-46da-a009-0102f1516d6e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.162332 Aug 31 19:25:54.363778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 90/168] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:54 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:54.884329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-ca4f4464-615d-42b9-8503-13b9045dda9c req-232f5e33-5700-4916-bd74-f3027ba3a3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9a1dbe-59be-491e-a129-aba5a3e1fe39", "name": "network-vif-plugged", "status": "completed", "tag": "945cd1b7-9a64-4d73-ab52-f3396a055dc3"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:25:54.894077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-ca4f4464-615d-42b9-8503-13b9045dda9c req-232f5e33-5700-4916-bd74-f3027ba3a3cc service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:54.894558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-ca4f4464-615d-42b9-8503-13b9045dda9c req-232f5e33-5700-4916-bd74-f3027ba3a3cc service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:54.895027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-ca4f4464-615d-42b9-8503-13b9045dda9c req-232f5e33-5700-4916-bd74-f3027ba3a3cc service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:54.906028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-ca4f4464-615d-42b9-8503-13b9045dda9c req-232f5e33-5700-4916-bd74-f3027ba3a3cc service nova] Creating event network-vif-plugged:945cd1b7-9a64-4d73-ab52-f3396a055dc3 for instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 on hv-cinder-85220 Aug 31 19:25:54.911101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-ca4f4464-615d-42b9-8503-13b9045dda9c req-232f5e33-5700-4916-bd74-f3027ba3a3cc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089427 Aug 31 19:25:54.911684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 79/169] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:25:54.996288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:54.996898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:55.003588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.004160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.004495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.005185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.005640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.006066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.139732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.147820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.149263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.150359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2f102186-d38b-4fbc-be15-8c98766c4205 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.157978 Aug 31 19:25:55.150926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 91/170] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:54 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:55.173591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:55.174284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:55.180426 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.180909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.181347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.182036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.182494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.183008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.320570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.327906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:55.328751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:55.328924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3f865179-8aa3-4af4-ae12-6e6d99a78529 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.159725 Aug 31 19:25:55.329601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 80/171] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:55 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:55.335028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.335534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.335975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.336741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.337153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.337586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.384179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:55.384791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:55.390897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.391525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.391971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.392674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:55.393136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:55.393626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:55.468225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.477292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a130e65f-a952-4e38-8daa-1b30b2e5dc41 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.153167 Aug 31 19:25:55.477872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 92/172] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:55 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:55.526759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:55.535345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ac373392-4757-41c8-ae08-faef1bcb0524 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.154951 Aug 31 19:25:55.535916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 81/173] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:55 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:56.173595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:56.174226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:56.180557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.181081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.181524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.182222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.182684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.183180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.317044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:56.325074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:56.326530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:56.327692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e083befb-adb3-4069-bae6-9ae7ceb708b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.158967 Aug 31 19:25:56.328259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 93/174] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:56 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:56.349112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:56.349729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:56.356015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.356503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.356974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.357676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.358296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.358734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.491488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:56.499031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:56.499330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-05481d18-6530-445e-83b9-49af6e9e43c7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.154043 Aug 31 19:25:56.499662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:56.500058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 82/175] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:56 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:56.506261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.506740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.507217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.507905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.508354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.508776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.556474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:56.557001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:56.563866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.564471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.564916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.565616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:56.566076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:56.566508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:56.639962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:56.649092 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-acd95aa7-f6ef-4b85-b36e-6e6b6adea489 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.153798 Aug 31 19:25:56.649875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 94/176] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:56 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:56.699820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:56.707552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e92d3e07-8f0f-4192-9052-c7480765e9af tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.155016 Aug 31 19:25:56.708117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 83/177] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:56 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:57.352008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:57.352916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:57.358699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.359499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.359959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.360599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.361067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.361499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.491991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.499986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.501966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.503097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1af386f7-7b13-4a09-9f2a-787cf8e9a5cb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.155605 Aug 31 19:25:57.503650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 95/178] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:57 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:57.520897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:57.521615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:57.527679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.532954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.532954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.532954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.532954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.533285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.667890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.669824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:57.670474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:57.676065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-82a15fb4-cf53-4a52-8064-4fa000d051a0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.160105 Aug 31 19:25:57.676627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 84/179] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:57 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:57.676947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.677436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.677875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.678580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.679145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.679576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.728921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:57.729528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:57.736471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.736965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.737405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.738109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:57.738563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:57.739015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:57.820584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.829899 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-40b9eeec-195a-4ea5-a18e-14756cc71597 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.163793 Aug 31 19:25:57.830671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 96/180] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:57 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:57.874731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:57.883307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-97350e25-c0f2-497b-83e1-35cd07763ba2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.158425 Aug 31 19:25:57.883876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 85/181] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:57 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:58.524974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:58.525584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:58.531777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.532191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.532624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.533865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.534351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.534772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.664428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:58.672462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:58.674410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:58.675562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-74f9943a-0920-4e64-8838-9950f267b4c8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.154447 Aug 31 19:25:58.676116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 97/182] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:58 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:25:58.699266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:58.699883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:58.706334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.706837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.707294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.707981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.708434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.708857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.842328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:58.850283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d3fbce33-6769-4507-8480-5fd6b77144f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.154763 Aug 31 19:25:58.850809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:58.850936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 86/183] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:58 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:58.851712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:58.858044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.858489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.858954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.859661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.860122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.860554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.904179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:58.904821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:58.911747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.912241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.912687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.913394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:58.913856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:58.914287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:58.992645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.000347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-100e2f4a-e3cf-4d1e-8219-e3b79f816e35 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.153409 Aug 31 19:25:59.000909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 98/184] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:58 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:25:59.043017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.051594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b7671043-3531-45fa-b490-17d9bd67111a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.151294 Aug 31 19:25:59.052159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 87/185] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:58 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:25:59.697558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:59.698161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:59.704169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:59.704681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:59.705213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:59.705897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:59.706346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:59.706769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:59.833418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.841784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.843586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:25:59.844581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5e6b11a2-8f4f-4519-be94-decf6d302c1c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.150862 Aug 31 19:25:59.845217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 99/186] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:25:59 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:25:59.873738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:25:59.874340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:25:59.876438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=99 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:25:59.881386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:59.881854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:59.882285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:25:59.882994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:25:59.883493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:25:59.888230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.017020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:00.021595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:00.022217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:00.025385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1acc584b-a411-4226-a66d-e78240e720c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.155359 Aug 31 19:26:00.039156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 88/187] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:25:59 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:00.039310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.039310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.039310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.039310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.039663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.039663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.072672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:00.073284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:00.079342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.080334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.081074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.082051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.082496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.083045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.168243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:00.177878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9caff3d6-f111-498c-8873-4a409a2f9d5d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.159717 Aug 31 19:26:00.178801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 100/188] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:00 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:00.232489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:00.240438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9ab3b4b7-c80a-4487-afb3-3c1f79538846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.171520 Aug 31 19:26:00.241009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 89/189] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:00 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:00.868045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:00.868705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:00.872120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:00.875342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.875834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.882690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:00.882690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:00.882690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:00.882690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.023109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.031813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.033673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.034854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dcf851b1-b174-4283-83c8-d980384fbb83 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.170721 Aug 31 19:26:01.035441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 101/190] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:00 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:01.051590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:01.052212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:01.058067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.058552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.059387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.060147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.060650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.061204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.192094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.197841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:01.198560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:01.200680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-eea6ad68-af85-4fa2-bc03-f3d8a93c0d2a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.153518 Aug 31 19:26:01.204153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 90/191] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:01 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:01.205869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.206471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.206947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.207669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.208173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.208610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.228737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:01.261935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:01.262614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:01.268680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.269297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.270039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.270984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:01.271660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:01.272278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:01.355389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.364432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5920271e-e645-4d60-b56e-d0c105bb0cf1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.170746 Aug 31 19:26:01.365004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 102/192] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:01 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:01.412531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:01.420540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-46786296-b43b-47ec-93ca-11306af0799e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.162647 Aug 31 19:26:01.421111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 91/193] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:01 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:02.058224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:02.058836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:02.065656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.066146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.066586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.067393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.067849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.068278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.203577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:02.211905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:02.213461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:02.214555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a5e487ba-e43e-4344-9875-9eb29054acb5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.160514 Aug 31 19:26:02.215142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 103/194] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:02 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:02.231308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:02.232048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:02.238924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.239415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.239856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.240595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.241161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.241479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.261322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:02.387064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:02.387375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:02.387689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:02.394758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.395282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.395730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.396423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.396886 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.397016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-102271a4-6b7e-4a11-a876-ed3fbb45ec4e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.178346 Aug 31 19:26:02.397625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.397768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 92/195] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:02 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:02.447981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:02.453046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:02.468588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.468960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.469644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.470462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:02.475390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:02.475390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:02.596411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:02.605029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9651eaa1-dfa2-4b07-8a10-260c189892ab tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.222693 Aug 31 19:26:02.605937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 104/196] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:02 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:02.648324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:02.656791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c28fcf6f-8de1-4b3a-86a3-166154268bb4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.217253 Aug 31 19:26:02.658467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 93/197] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:02 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:03.238777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:03.239372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:03.245481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.245965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.246404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.247137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.247640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.248122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.382194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.390351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.391885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.393616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6b17a530-a31d-44c4-a672-5e3523c7dfc2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.159064 Aug 31 19:26:03.394178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 105/198] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:03 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:03.418044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:03.418684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:03.424703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.425260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.425696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.426382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.426832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.427287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.560050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.568780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-96396576-97c7-46df-8373-0b904c34719a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.154557 Aug 31 19:26:03.569343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 94/199] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:03 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:03.627285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:03.627963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:03.633931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.634442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.634898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.635799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.636183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.636555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.679967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:03.680727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:03.692559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.693388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.694011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.695268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:03.695929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:03.696545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:03.784853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.793117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-55bd42d3-853b-4f28-bffa-f02d0785b25e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.170293 Aug 31 19:26:03.794020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 106/200] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:03 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:03.834267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:03.841920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-73cda442-efc5-4e9d-bfbc-d42aea027fa1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.166993 Aug 31 19:26:03.842466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 95/201] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:03 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:04.415987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:04.416593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:04.422651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.423168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.423602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.425008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.425498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.425914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.554830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.562896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.564335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.566424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5931b56f-10b8-45ab-b147-86a7481f681f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.154549 Aug 31 19:26:04.566995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 107/202] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:04 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:04.589307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:04.589922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:04.596036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.596733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.597174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.597868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.598325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.598758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.733266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.743180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-820146a7-c5f6-4f7d-b6ce-de47739a4dae tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.157518 Aug 31 19:26:04.746965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 96/203] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:04 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:04.816172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:04.816816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:04.823462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.823939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.824373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.825095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.825546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.826058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.863703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:04.864657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:04.872431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.872913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.873347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.874043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:04.874495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:04.874931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:04.960106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:04.967912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-696f59ca-6c90-4aeb-8c8d-0f3932178262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.155730 Aug 31 19:26:04.968480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 108/204] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:04 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:05.007160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.014769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bbe8b12f-4716-4430-86d1-f30f5b565b77 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.155653 Aug 31 19:26:05.015360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 97/205] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:04 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:05.588219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:05.588835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:05.595012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.595506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.595994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.600834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.600834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.600834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.728425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.736889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.738404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.739541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0ea073ac-6d0f-44ff-90b9-0c76524872a4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.155713 Aug 31 19:26:05.740102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 109/206] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:05 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:05.765236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:05.766118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:05.774318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.774996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.775633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.776556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.776962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.777401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.911514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:05.919398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-41ea867e-c652-432b-9db2-07d89404989d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.158127 Aug 31 19:26:05.919952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 98/207] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:05 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:05.989721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:05.990327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:05.996287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.996769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.997202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:05.997890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:05.998345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:05.998831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.036180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:06.036736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:06.042966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.043448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.043880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.044615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.045069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.046601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.132955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:06.140760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-419a092e-9af2-4223-95ab-2a1c582174b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.155159 Aug 31 19:26:06.141332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 110/208] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:05 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:06.176821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:06.184431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6c027556-ee08-446e-9615-de5d419e830f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.152249 Aug 31 19:26:06.184992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 99/209] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:06 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:06.762156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:06.762723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:06.769373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.769848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.770300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.771007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.771461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.771880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.903073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:06.911920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:06.913341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:06.914435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5bffb251-f01f-4aa4-9705-cd9ee9419312 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.156277 Aug 31 19:26:06.915016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 111/210] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:06 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:06.939673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:06.940328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:06.946256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.946736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.947216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:06.947921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:06.948380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:06.948812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.083800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:07.091330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e02eefea-c465-403e-96eb-a7c76580ab01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.155339 Aug 31 19:26:07.091898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 100/211] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:06 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:07.162033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:07.162638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:07.168566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.169044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.169471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.170163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.170612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.171066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.205615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:07.206228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:07.213212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.213695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.214125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.215059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.215509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.215931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.304595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:07.312484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bcbacd9-4bcd-409c-9610-9afa4dfe92a4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.154533 Aug 31 19:26:07.313054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 112/212] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:07 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:07.348001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:07.355896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-abca2da4-73d4-409a-b273-49b554e60323 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.154292 Aug 31 19:26:07.356462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 101/213] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:07 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:07.936752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:07.937363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:07.943448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.943937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.944375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:07.945068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:07.945529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:07.945962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.080442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.088770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.090206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.091322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-53ee0e48-f42d-44ef-b23e-9745dcec1a55 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.158493 Aug 31 19:26:08.092004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 113/214] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:07 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:08.113526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:08.114364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:08.120342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.120827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.121267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.121960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.122418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.122845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.251080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.259105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-68f0596e-9c27-42f2-943a-c56c5a60d093 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.150038 Aug 31 19:26:08.259742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 102/215] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:08 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:08.334364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:08.335042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:08.340924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.341404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.341841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.342529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.343012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.343439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.376604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:08.377171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:08.383469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.383961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.384404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.385110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:08.385571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:08.386123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:08.474387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.482379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8d0e474d-a2fe-4194-8ce4-eef0c51922e1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.152657 Aug 31 19:26:08.482964 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 114/216] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:08 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:08.522442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:08.529954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-20398f62-66e6-43f8-8cf4-3c27ce017660 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.157270 Aug 31 19:26:08.530507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 103/217] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:08 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:09.113993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.114614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.120647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.121137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.121579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.122271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.122735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.123182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.265767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.282374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.283699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.284419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.288858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.292522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6ef363b1-29cb-4bcc-abc1-17f65d1b6302 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.182644 Aug 31 19:26:09.293752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 115/218] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:09 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:09.310539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.315789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.315789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.315789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.315789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.316326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.458132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.466500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cb5252d6-d274-4f80-850c-f60b4ed9e1a4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.189241 Aug 31 19:26:09.467212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 104/219] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:09 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:09.504050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.504817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.510833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.511376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.511848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.512585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.513049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.513509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.551933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:09.552543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:09.558702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.559232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.559678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.560400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:09.561041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:09.561348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:09.667259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.667259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2fa96afd-a96a-4b52-9320-81fbbbca828d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.166672 Aug 31 19:26:09.667259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 116/220] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:09 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:09.717412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:09.725495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2dc5f800-dc42-46cf-8e74-34402af2187e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.177435 Aug 31 19:26:09.726076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 105/221] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:09 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:10.323595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:10.324538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:10.331063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.331566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.332188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.333126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.333607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.334040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.489745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:10.492431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:10.501613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.502377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.503052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.504814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.505412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.505911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.507294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:10.523236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:10.525583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:10.527704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6cab0573-4048-4f92-8599-2019b29bc6de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.207539 Aug 31 19:26:10.544064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 117/222] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:10 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:10.658768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-b8f20540-644d-4757-8403-4d28ece5f868 req-69f15594-b920-4869-81b4-f63fbeb9a7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d920f4b-fb26-4da7-a545-49ccbc5fcaff", "name": "network-vif-plugged", "status": "completed", "tag": "f411081e-0621-4211-b73b-5d11871d58bb"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:10.673713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b8f20540-644d-4757-8403-4d28ece5f868 req-69f15594-b920-4869-81b4-f63fbeb9a7e1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.674657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b8f20540-644d-4757-8403-4d28ece5f868 req-69f15594-b920-4869-81b4-f63fbeb9a7e1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.675637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b8f20540-644d-4757-8403-4d28ece5f868 req-69f15594-b920-4869-81b4-f63fbeb9a7e1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.703435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-b8f20540-644d-4757-8403-4d28ece5f868 req-69f15594-b920-4869-81b4-f63fbeb9a7e1 service nova] Creating event network-vif-plugged:f411081e-0621-4211-b73b-5d11871d58bb for instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff on hv-cinder-85220 Aug 31 19:26:10.709884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-b8f20540-644d-4757-8403-4d28ece5f868 req-69f15594-b920-4869-81b4-f63fbeb9a7e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056419 Aug 31 19:26:10.710609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 118/223] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:10.716189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:10.717195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:10.728405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.729182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.729799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.730808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.731435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.732146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.745689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:10.754303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e50f9d98-6249-43fc-b8be-25d4505807c9 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.269291 Aug 31 19:26:10.757824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 106/224] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:10 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:10.772764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:10.777789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:10.786279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.786832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.787301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.788007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:10.788463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:10.792681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:10.963812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:10.973687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bf96acf3-5c2f-44e9-8fbf-45449b09eff8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.212138 Aug 31 19:26:10.974521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 107/225] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:10 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:11.093567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.096912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:11.102416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cef4448f-0bff-4814-aa36-d244c336131c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.390494 Aug 31 19:26:11.103009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 119/226] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:10 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:11.554575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:11.555301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:11.564598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:11.566194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:11.568084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:11.569492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:11.570215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:11.570816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:11.771554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.781513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:11.782127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:11.792953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.794592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:11.796766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.801842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:11.801842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:11.801842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:11.801842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:11.802339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:11.804670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fc25b943-b912-4f33-abc4-e99cdd04dabe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.248285 Aug 31 19:26:11.819395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 108/227] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:11 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:11.958924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:11.966793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ca7cb5c5-c9a9-443c-93fa-e9d3194542f6 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.190257 Aug 31 19:26:11.967392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 120/228] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:11 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:11.994783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:11.995435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.004392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.004392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.004392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.004392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.004844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.004844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.008637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:12.124916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.125526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.132430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.133161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.133630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.134343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.134902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.135243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.148134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:12.164651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e7fc01be-7b07-4326-bf2e-a2a84bda7ba8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.173658 Aug 31 19:26:12.165521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 109/229] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:11 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:12.275448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:12.284187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2a2a298a-4e84-4e58-9557-f7d7245e6714 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.163179 Aug 31 19:26:12.285922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 121/230] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:12.829952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.830424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.837419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.837915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.838354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.839086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.839545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.839973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.988078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:12.988780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:12.994839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.995358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.995794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:12.996490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:12.996944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:12.997368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.025090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.034046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.036302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.037547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2dc035a9-c968-4c97-8d89-c14201e9d2c7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.211390 Aug 31 19:26:13.038302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 110/231] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:13.136870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.147046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f774da56-8b40-4b33-9006-d0a6622c0fa4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.162773 Aug 31 19:26:13.147933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 122/232] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:12 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:13.186861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:13.187656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:13.194667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.196612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.196983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.197776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.198272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.198703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.306057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:13.307066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:13.313763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.314282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.314727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.315496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:13.316508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:13.316953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:13.344970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.353220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c7af4e6b-8991-4d1c-ab00-5a9a6946636b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.170197 Aug 31 19:26:13.353790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 111/233] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:13 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:13.458230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:13.466771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-194c70f7-fbf1-44a0-b8c5-2e5c01ecdbfe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.164852 Aug 31 19:26:13.467368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 123/234] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:13 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:14.060305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:14.060898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.067204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.072286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.072286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.072286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.072286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.072621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.170345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:14.170991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.182575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.183098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.183735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.184443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.184890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.185319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.205215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.214414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.215947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.217116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1161123a-0ef6-4a38-be9f-6965a3c81dde tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.160733 Aug 31 19:26:14.217674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 112/235] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:14 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:14.335870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.343486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f1e92465-f104-4209-b593-c1c5db2ecd40 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.177242 Aug 31 19:26:14.344043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 124/236] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:14 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:14.373557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:14.374384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.380612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.381106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.381549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.382257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.382755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.383227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.489709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:14.490829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:14.497566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.498157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.498903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.499709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:14.500486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:14.501010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:14.521441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.530517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5d755bd8-2a97-4a86-a0e6-12b8d5643e2d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.160894 Aug 31 19:26:14.533922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 113/237] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:14 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:14.643453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:14.652535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e235f43e-32a1-4be3-80c3-3281df3c622b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.166953 Aug 31 19:26:14.653114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 125/238] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:14 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:15.243503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:15.244121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:15.250199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.250685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.251165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.251862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.252396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.252829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.366020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:15.366737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:15.373004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.373583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.374096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.374813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.375303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.375733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.390733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.399356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.401122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.402228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3bc77070-63e5-4231-956a-4807b1c0a031 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.162809 Aug 31 19:26:15.402782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 114/239] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:15 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:15.513201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.520797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dda41dd3-0568-4ce8-8d43-f58559589a0a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.159635 Aug 31 19:26:15.521367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 126/240] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:15 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:15.551889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:15.552496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:15.559285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.559833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.560271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.561291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.561785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.562359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.678428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:15.682376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:15.685185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.685660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.686173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.686907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:15.687443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:15.687766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:15.712118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.716351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2a8b44c3-deb9-4c19-8915-12c18f5d2ee2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.169046 Aug 31 19:26:15.717852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 115/241] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:15 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:15.842157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:15.850750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0cfcf9f4-ca87-4988-acf6-8652cd952fbe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.176771 Aug 31 19:26:15.851599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 127/242] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:15 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:16.425655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.426346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.432273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.432752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.433250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.433898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.434350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.434767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.541354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.541984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.547929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.548411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.548905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.549548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.550497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.551134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.573275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:16.581448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:16.582959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:16.584075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-71a758b4-7e2b-4d71-ad2a-33172f61d2be tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.162525 Aug 31 19:26:16.584633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 116/243] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:16.689975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:16.698752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8c3d3745-5f11-4168-b85c-1acaf06583b0 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.161153 Aug 31 19:26:16.699374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 128/244] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:16.746906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.747494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.755533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.756757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.757427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.758275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.759850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.760448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.885663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:16.886685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:16.898772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.898772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.898772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.899163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:16.899394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:16.899830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:16.932405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:16.943528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-02193574-e252-4536-b4e6-98f7bb9709ec tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.200317 Aug 31 19:26:16.944380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 117/245] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:17.043694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.052273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-171ffa80-2e27-4923-8547-c668958b2682 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.177888 Aug 31 19:26:17.052830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 129/246] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:16 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:17.605914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:17.606525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:17.613036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.613565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.614053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.614776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.615255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.615676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.719075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:17.719688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:17.726671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.727192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.727630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.728332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.728790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.729217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.752041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.760632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.762072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.763205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5225d5aa-b516-435c-b844-2c7aaa719e40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.161184 Aug 31 19:26:17.763754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 118/247] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:17 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:17.864353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:17.872057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-832a78a7-9c4e-4dd2-8079-fda46c0dfa5e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.156914 Aug 31 19:26:17.872620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 130/248] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:17 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:17.964318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:17.965023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:17.971189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.971678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.972139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:17.972935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:17.973396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:17.973827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.079499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:18.080657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.098051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.099146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.100025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.104365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.105302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.106272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.130342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.138486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-421e070f-5bcd-443e-a3b1-1bd3164f70b1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.177978 Aug 31 19:26:18.139090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 119/249] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:17 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:18.241966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.249984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-66886230-41e2-4688-875d-8a71ecb3ed07 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.180006 Aug 31 19:26:18.250565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 131/250] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:18 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:18.786605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:18.787175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.793152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.793636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.794077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.794770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.795275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.795714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.893059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:18.893736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:18.899875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.900359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.900789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.901485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:18.901932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:18.902366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:18.927588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.935744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.937332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:18.938445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-650a2fe0-3534-4f14-b903-69035286b8ed tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.156584 Aug 31 19:26:18.939041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 120/251] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:18 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:19.034230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:19.053333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-986a7d5f-ed1f-41a9-8abf-9ae8625fef04 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.152864 Aug 31 19:26:19.053333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 132/252] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:18 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:19.160298 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:19.160899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:19.167010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.167505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.167941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.168636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.169172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.169518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.271814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:19.272602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:19.279080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.279650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.280188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.280967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.281642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.282486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.319082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:19.329473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c7f3b221-d156-4e4b-9e17-188877c12f46 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.173357 Aug 31 19:26:19.330626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 121/253] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:19 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:19.451304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:19.459761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f4900382-6d60-4785-8681-498c73c421d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.192002 Aug 31 19:26:19.460382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 133/254] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:19 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:19.961695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:19.962304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:19.968436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.968968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.969429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:19.970135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:19.970596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:19.971071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.063693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:20.064400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.071198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.071692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.072129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.072834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.073294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.073725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.100538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.109201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.110731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.111943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6a59b01e-d60e-40f8-8a1e-3d72d6680584 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.154205 Aug 31 19:26:20.112793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 122/255] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:19 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:20.205572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.213971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d121e6e8-e65e-4b36-bead-6dfb4cda3dec tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.154010 Aug 31 19:26:20.214541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 134/256] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:20 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:20.354451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:20.355035 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.361004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.361482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.361918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.363114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.363571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.363993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.481890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:20.482494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:20.489198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.489773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.490246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.491039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:20.491506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:20.491946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:20.494260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.502074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5046af40-b582-4262-af59-1057aa8a03ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.151771 Aug 31 19:26:20.502642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 123/257] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:20 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:20.624872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:20.633318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2ef2cd70-73b9-4ddf-a256-e6c556509cf4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.155151 Aug 31 19:26:20.633900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 135/258] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:20 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:21.134282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.134838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.140790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.141268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.141702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.142386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.142838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.143285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.234659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.235433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.241998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.242539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.243003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.243839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.244187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.244607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.262591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:21.275296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.290957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.292386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.293596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-81e15de3-c2ad-4852-a2d0-fe608534b5ac tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.163250 Aug 31 19:26:21.294150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 124/259] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:21.382931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.390585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-07b08697-fb3c-45b3-b575-a59938f72f71 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.159746 Aug 31 19:26:21.391113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 136/260] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:21.523793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.524400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.530388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.530886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.531345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.532038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.532499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.532934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.653632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:21.654367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:21.660670 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.661359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.661849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.664615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:21.664615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:21.664615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:21.669210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.672708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:21.677210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3abb6698-de72-49c8-8613-279db94c2b06 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.157224 Aug 31 19:26:21.677770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 125/261] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:21.792105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:21.799682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-74bc3e0b-227a-4da3-a117-b4c53285381f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.150023 Aug 31 19:26:21.801004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 137/262] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:21 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:22.315193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:22.316639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:22.323195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.323689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.324129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.324836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.325295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.325724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.413266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:22.414090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:22.420889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.421599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.422253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.423258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.424101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.424356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.479390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.487883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.489746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.490854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f0661c32-2dd3-4e5a-bd45-1207c4bc06af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.179754 Aug 31 19:26:22.491486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 126/263] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:22 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:22.563007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.570942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8fdd7338-02a4-42ad-bbfe-81d10c2212bc tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.162325 Aug 31 19:26:22.571834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 138/264] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:22 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:22.697811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:22.698415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:22.704676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.705170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.705613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.706318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.706790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.707245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.821957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:22.822574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:22.828478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.828970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.829414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.830110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:22.830572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:22.831033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:22.834984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.842617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-90d22fca-47ad-4bcc-86e3-fc1e5f3db615 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.148516 Aug 31 19:26:22.843405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 127/265] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:22 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:22.964302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:22.972513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-38b496d9-97b3-428a-bf9e-b341226e39c5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.153904 Aug 31 19:26:22.973333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 139/266] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:22 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:23.513580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:23.514196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:23.520628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.521111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.521546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.522239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.522749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.523201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.592724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:23.593346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:23.599276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.599768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.600212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.600916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.601634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.602057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.662826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.673276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.675750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.677277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dcba3718-7ef5-4482-bf4d-b3cc6620d7b1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.167559 Aug 31 19:26:23.678207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 128/267] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:23 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:23.713007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-0e3791b3-3b20-4e27-9446-0817b7c51f39 req-ec01b658-18fd-451f-b94c-26384e69f9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04777b04-7baf-471b-a244-e91bc64cb15b", "name": "network-vif-plugged", "status": "completed", "tag": "fedebd72-d0d8-4183-bb59-913256ef56e7"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:23.724406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-0e3791b3-3b20-4e27-9446-0817b7c51f39 req-ec01b658-18fd-451f-b94c-26384e69f9e4 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.725348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-0e3791b3-3b20-4e27-9446-0817b7c51f39 req-ec01b658-18fd-451f-b94c-26384e69f9e4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.725863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-0e3791b3-3b20-4e27-9446-0817b7c51f39 req-ec01b658-18fd-451f-b94c-26384e69f9e4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.745020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:23.756113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1b4b8ddc-6f18-4469-9e32-1189bcfab6c5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.166616 Aug 31 19:26:23.770937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-0e3791b3-3b20-4e27-9446-0817b7c51f39 req-ec01b658-18fd-451f-b94c-26384e69f9e4 service nova] Creating event network-vif-plugged:fedebd72-d0d8-4183-bb59-913256ef56e7 for instance 04777b04-7baf-471b-a244-e91bc64cb15b on hv-cinder-85220 Aug 31 19:26:23.770937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-0e3791b3-3b20-4e27-9446-0817b7c51f39 req-ec01b658-18fd-451f-b94c-26384e69f9e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054546 Aug 31 19:26:23.770937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 129/268] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:23.774473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 140/269] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:23 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:23.865656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:23.866694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:23.874295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.875145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.875787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.876800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:23.877366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:23.882959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:23.996339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.004424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.009969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.011993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.012649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.013779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.014449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.015122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.074024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.083566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4d49608c-9b35-4740-acd7-c9e725e0111b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.222511 Aug 31 19:26:24.095494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 130/270] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:23 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:24.176491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.184966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0af150c1-acba-4a2e-abb9-991a4561b526 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.193652 Aug 31 19:26:24.185546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 141/271] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:23 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:24.700583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.701809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.709117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.709616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.710094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.711090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.711786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.712203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.778167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:24.778841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:24.786071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.786763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.787231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.787944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:24.788403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:24.788838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:24.870573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.879500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.883573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.884727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d954309d-44bb-410a-8b4a-6558123935f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.188453 Aug 31 19:26:24.895902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 131/272] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:24 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:24.925526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:24.933174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b3a9ea7f-9a35-4537-ad2f-0d01660fef8d tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.159348 Aug 31 19:26:24.933929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 142/273] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:24 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:25.105387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.105998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.112664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.113654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.113654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.114349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.114892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.115367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.207089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.207705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.213680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.214135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.214588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.215320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.215780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.216211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.288972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:25.302009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6354ce1a-f66c-4218-8961-1c7bab0cd657 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.200641 Aug 31 19:26:25.305458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 132/274] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:25.405960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:25.416173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1fae7c8a-e889-4409-8007-20f99b77bb77 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.213351 Aug 31 19:26:25.418913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 143/275] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:25.778995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-9f695ff1-b5e4-4aa7-ad59-9f6e8c0812ab req-f9fd9095-1e7c-4d0e-be88-0dce30d651fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf99492-1198-453d-9f3b-f4f8bdbc225a", "name": "network-vif-plugged", "status": "completed", "tag": "531806c1-a1f4-449c-a1b4-ec4835b2b388"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:25.790326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-9f695ff1-b5e4-4aa7-ad59-9f6e8c0812ab req-f9fd9095-1e7c-4d0e-be88-0dce30d651fa service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.790810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-9f695ff1-b5e4-4aa7-ad59-9f6e8c0812ab req-f9fd9095-1e7c-4d0e-be88-0dce30d651fa service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.791376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-9f695ff1-b5e4-4aa7-ad59-9f6e8c0812ab req-f9fd9095-1e7c-4d0e-be88-0dce30d651fa service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.803737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-9f695ff1-b5e4-4aa7-ad59-9f6e8c0812ab req-f9fd9095-1e7c-4d0e-be88-0dce30d651fa service nova] Creating event network-vif-plugged:531806c1-a1f4-449c-a1b4-ec4835b2b388 for instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a on hv-cinder-85220 Aug 31 19:26:25.812902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-9f695ff1-b5e4-4aa7-ad59-9f6e8c0812ab req-f9fd9095-1e7c-4d0e-be88-0dce30d651fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037579 Aug 31 19:26:25.817778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 133/276] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:25.908769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.909378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.915305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.915792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.916231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.916937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.917406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.917840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.954693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:25.955649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:25.962900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.963512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.964055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:25.964826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:25.965454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:25.965949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.053879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.061959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.063817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.064514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3e36c13c-78c8-4a65-9840-6ae3668c73db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.159740 Aug 31 19:26:26.065103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 144/277] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:26.100377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.108289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2cc2523d-5593-4eec-ae91-84c7b700c693 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.157630 Aug 31 19:26:26.108850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 134/278] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:25 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:26.328046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:26.328662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:26.334894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:26.335383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:26.335824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.336520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:26.336980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:26.337442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.437594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:26.438234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:26.445420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:26.445915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:26.446355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.447095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:26.447554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:26.447986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:26.466337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.474094 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d3c591a4-1273-40b1-9397-ebf583603c90 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.149922 Aug 31 19:26:26.474664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 145/279] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:26 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:26.578534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:26.586219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f90f2fb4-e348-43e7-82ad-84681d0fd314 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.152484 Aug 31 19:26:26.586782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 135/280] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:26 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:27.087943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:27.088557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:27.094712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.095235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.095675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.096369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.097467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.097898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.129388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:27.130575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:27.136758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.137245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.137699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.138384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.138841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.139591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.232755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.241014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.242464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.243601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d343bb49-a6f2-4262-960d-d4842be8c98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.159667 Aug 31 19:26:27.244157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 146/281] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:27 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:27.276451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.284842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1071aeda-1678-4dce-9e1a-5b6c34d19a54 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.158758 Aug 31 19:26:27.285407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 136/282] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:27 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:27.494818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:27.495367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:27.501301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.501779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.502208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.503502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.503985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.504486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.606865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:27.607490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:27.613722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.614294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.614731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.615635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:27.616090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:27.616515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:27.633056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.640716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c11069d5-a407-465b-9bc8-bad54990cec0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.149752 Aug 31 19:26:27.641282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 147/283] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:27 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:27.744903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:27.752805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-196badf9-4c5f-47fc-9ae2-b675f387ee1f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.149720 Aug 31 19:26:27.754457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 137/284] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:27 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:28.265446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:28.266064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:28.272413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.272901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.273342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.274041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.274500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.274958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.305797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:28.306397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:28.308404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:28.313473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.313955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.314388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.315177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.315801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.316228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.410458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.420056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.421640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.422752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-94f0ad57-3075-45bc-9ea0-df89f482ef7f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.161206 Aug 31 19:26:28.423327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 148/285] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:28 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:28.455418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.464532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-87f84986-6df0-4fb7-b02e-8e31d9c58af7 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.162440 Aug 31 19:26:28.465464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 138/286] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:28 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:28.663373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:28.664013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:28.669956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.670463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.670928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.682965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.682965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.682965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.774985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:28.775607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:28.781705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.782191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.782628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.783418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:28.783876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:28.785008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:28.803946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.812168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-390697f6-584d-45d8-80d6-071d3d8c056d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.153496 Aug 31 19:26:28.812744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 149/287] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:28 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:28.921804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:28.929680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c6cd734c-79a4-4526-a0bf-b2d338e48011 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.158703 Aug 31 19:26:28.930245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 139/288] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:28 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:29.445463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:29.446097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:29.452064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.452625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.452974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.453655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.454105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.454526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.485405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:29.486017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:29.492854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.493344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.493785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.494493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.494979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.495421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.586598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.594933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.596370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.597567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3b94e96c-6cc1-4db7-b27f-ba6f179bda75 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.156005 Aug 31 19:26:29.598137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 150/289] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:29 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:29.627751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.636369 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-69b7c32f-3028-4a9c-ba53-7e3a81229e82 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.154765 Aug 31 19:26:29.636926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 140/290] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:29 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:29.833245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:29.834717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:29.837638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:29.841150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.841661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.842252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.842820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.843303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.843734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.950572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:29.951271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:29.957322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.957801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.958239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.958963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:29.959415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:29.959837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:29.980884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:29.989074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-801e62f7-18cb-49e2-970d-ad61a1152e59 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.159853 Aug 31 19:26:29.989654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 151/291] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:29 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:30.095253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.104318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-707e9c51-8fcd-47f4-9070-1a570493d924 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.157541 Aug 31 19:26:30.104885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 141/292] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:29 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:30.620982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:30.621645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:30.627448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.628475 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.628913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.629602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.630086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.630516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.656488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:30.657095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:30.663172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.663666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.664110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.664902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:30.665361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:30.665792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:30.763253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.773478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.775104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.776373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-759ee4fd-b47e-4626-a39c-04b8b6769c4b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.159418 Aug 31 19:26:30.777038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 152/293] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:30 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:30.804192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:30.812177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8bb50d5c-60c0-42ba-96c6-cba0ce18a7cd tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.159172 Aug 31 19:26:30.812736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 142/294] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:30 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:31.010754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:31.011452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:31.017622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.018114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.018821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.024242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.024242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.024242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.026331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:31.125616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:31.127457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:31.148442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.149198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.149735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.150570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.151282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.151783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.173510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:31.174198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7a602ce7-4eee-4c2b-b17c-549d6ffc5754 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.167662 Aug 31 19:26:31.175512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 153/295] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:31 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:31.286465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:31.289920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:31.294391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2f04509a-d931-4c96-9b88-20ed6cf8da3d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.173862 Aug 31 19:26:31.295010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 143/296] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:31 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:31.798370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:31.799079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:31.804988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.805465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.805900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.806591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.807071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.807492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.834587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:31.835849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:31.847884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.848406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.848848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:31.849558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:31.850025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:31.850455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.028762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.028762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.029569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.029569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-af4d6259-8399-4c40-8c64-263c9607d1f8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.176400 Aug 31 19:26:32.029569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 154/297] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:31 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:32.030150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.030150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c672dc30-adca-4245-957a-1bc2e7bf17f1 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.167331 Aug 31 19:26:32.030150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 144/298] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:31 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:32.197296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:32.197913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:32.203919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.205309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.205309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.205872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.206354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.206789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.317952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:32.318572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:32.324598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.325089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.325601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.326309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.326767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.327231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.368361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.403210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8074ee30-f5b9-4b06-a5a2-9aeb02a79393 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.210843 Aug 31 19:26:32.403812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 155/299] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:32 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:32.717727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-79e21185-aff5-4612-9687-316c8b18d0db req-57508b08-b094-4c13-afc5-371c3405826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "name": "network-vif-plugged", "status": "completed", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:32.719612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:32.730192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-77931892-19b3-49b3-9948-6b300b86ed52 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.416942 Aug 31 19:26:32.730931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 145/300] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:32 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:32.731728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-79e21185-aff5-4612-9687-316c8b18d0db req-57508b08-b094-4c13-afc5-371c3405826a service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:32.732313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-79e21185-aff5-4612-9687-316c8b18d0db req-57508b08-b094-4c13-afc5-371c3405826a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:32.732877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-79e21185-aff5-4612-9687-316c8b18d0db req-57508b08-b094-4c13-afc5-371c3405826a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:32.758196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-79e21185-aff5-4612-9687-316c8b18d0db req-57508b08-b094-4c13-afc5-371c3405826a service nova] Creating event network-vif-plugged:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:26:32.765913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-79e21185-aff5-4612-9687-316c8b18d0db req-57508b08-b094-4c13-afc5-371c3405826a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051737 Aug 31 19:26:32.766753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 156/301] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:32.995077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:32.995682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:33.001835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.002569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.003821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.004728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.005186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.005907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.021405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:33.022211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:33.028059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.028544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.028983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.029751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.030210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.030636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.172098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.181784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.183563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.185065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1b80b8ae-8002-478c-b047-6088a873227f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.194222 Aug 31 19:26:33.185625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 146/302] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:32 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:33.193792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.203162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a9e303ae-badb-4f13-988b-bac856d2bb7c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.187813 Aug 31 19:26:33.204000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 157/303] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:33 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:33.428329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:33.428329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:33.432767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.433592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.433815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.434500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.435286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.435551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.606527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.614977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-53dd4860-bdd9-4cd2-a19b-94abee47e54a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.194479 Aug 31 19:26:33.615553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 147/304] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:33 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:33.752509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:33.753929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:33.761115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.761893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.762527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.763435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:33.764224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:33.764829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:33.930987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:33.938661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b75b60dc-2ade-4f84-9ee1-b9e707919cc2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1322 microversion: 2.1 time: 0.190470 Aug 31 19:26:33.939263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 158/305] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:33 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:34.226384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:34.226384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:34.226384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.226384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.227451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.227451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.227451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.227451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.227758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:34.228631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:34.235593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.236107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.236744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.237459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.237919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.239013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.398270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.401326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.406677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0624fca6-9b4c-4fe4-a367-23e25036c334 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.185415 Aug 31 19:26:34.407884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 159/306] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:34 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:34.409913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.412176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.413289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1fb3d98f-cbd7-42cf-aaaa-46aec8ece160 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.209825 Aug 31 19:26:34.413831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 148/307] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:34 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:34.636055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:34.636739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:34.646850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.648426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.649054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.650042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.650509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.651279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.806942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:34.815702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b5132725-f977-4b18-9ba6-ee813b2d2634 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.183537 Aug 31 19:26:34.817086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 160/308] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:34 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:34.966389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:34.968458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:34.978299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.978785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.979348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:34.980055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:34.980508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:34.981115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.118634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.126859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-76f1ce4b-6cee-47eb-8971-ce9f48609bca tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1516 microversion: 2.1 time: 0.167695 Aug 31 19:26:35.127449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 149/309] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:34 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:35.147826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:35.150146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.156779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.157322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.157767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.158486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.158995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.159472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.234394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'flavor' on Instance uuid 2d920f4b-fb26-4da7-a545-49ccbc5fcaff {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:26:35.449174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:35.450499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.470299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.471547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.473928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.475028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.475729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.476711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.641825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.659955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-91c19867-35df-44bb-a37e-591cab7b2e01 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.220916 Aug 31 19:26:35.660963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 150/310] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:35 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:35.675136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:35.675815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.683970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.684152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-086647af-1a9c-4745-a330-a3f8efd5d502 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff/action" status: 200 len: 32 microversion: 2.1 time: 0.540030 Aug 31 19:26:35.686399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.686399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.686399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.686399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.686747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.689945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 161/311] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:26:35 2022] POST /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff/action => generated 32 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:26:35.699121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:35.700073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.708755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.709383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.709840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.710528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.711036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.711459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.856456 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.865492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.866958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.868287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8c27c714-5c00-4823-a863-d4dbb21afbaa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.206311 Aug 31 19:26:35.868822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 151/312] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:35 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:35.873413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:35.874227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:35.881158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.881836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.882429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.915063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:35.915063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:35.915063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:35.916144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:35.916144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-70089141-8dcd-4f30-a94d-51f2f206593b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.215980 Aug 31 19:26:35.916144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 162/313] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:35 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:36.027899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:36.038214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-53267d65-b7bc-4727-99a9-f9c62def70f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.168203 Aug 31 19:26:36.038790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 152/314] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:35 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:36.681984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:36.683385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:36.689868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.696984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.696984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.696984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.696984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.697317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.834504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:36.844495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-146a0e44-0f47-4f14-8c4b-c606774e1585 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.166325 Aug 31 19:26:36.845189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 163/315] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:36 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:36.893552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:36.894326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:36.900449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.901050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.901582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.902387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.903076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.903862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.937153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:36.938077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:36.945948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.946550 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.947034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:36.947819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:36.949411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:36.949411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.086384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.094659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.096300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.097252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-13d64c5d-94cf-447f-b964-bddf2bab5651 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.207779 Aug 31 19:26:37.097376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.099001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 153/316] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:36 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:37.115078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:37.115185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0c264aff-9ade-497c-b3bb-136c3abf6338 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.173223 Aug 31 19:26:37.115277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:37.115375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 164/317] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:36 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:37.115461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.115461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.115461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.115461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.115763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.115763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.275099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:37.288479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4449d2bf-3c98-415c-8fbe-6ba1d3db18e2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1362 microversion: 2.1 time: 0.187993 Aug 31 19:26:37.289231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 154/318] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:37 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:37.866161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:37.866922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:37.873798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.874316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.874744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:37.875672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:37.876298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:37.876891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.098476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.107341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-53dd00b8-0a3b-4bc2-b4e1-5c07ffafa914 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1315 microversion: 2.1 time: 0.245468 Aug 31 19:26:38.108099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 165/319] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:37 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:38.122291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.122965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.128924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.129706 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.130219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.130714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.131274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.132280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.132737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.133166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.136787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.137380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.138061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.139262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.139988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.147550 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.308168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.315819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9e60ea40-68f8-494a-a3d0-5b8f15986d29 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.190689 Aug 31 19:26:38.316737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 166/320] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:38.327401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.328079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.335665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.336151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.339771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.342041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.342818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.343469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.345387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.348796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.350509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.352137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e55ceeaa-6bd1-4ad5-b74b-42086ee9d664 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.234260 Aug 31 19:26:38.352776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 155/321] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:38.486934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:38.496727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6057f725-aed9-44ca-a50d-28c743440bf4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1547 microversion: 2.1 time: 0.178890 Aug 31 19:26:38.497685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 167/322] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:38.519588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:38.520148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:38.526726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.527254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.528024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.528739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:38.529203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:38.529632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:38.647703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-79192123-8ca8-4940-8da5-c484284a91ab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132306 Aug 31 19:26:38.648308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 156/323] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:26:38 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:39.130273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:39.131610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:39.144866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.145564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.146075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.146891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.147412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.148063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.168102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:39.338578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:39.339353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:39.345900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.346392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.347139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.348577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.349420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.349857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.494948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.508301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c1589a5f-5dff-4e3b-8724-353bb8889c69 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.173736 Aug 31 19:26:39.509257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 157/324] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:39 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:26:39.513963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:39.514788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:39.521896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.522568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.523044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.523934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:39.524640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:39.525222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:39.657003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.666434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9f6ae211-bc79-4f08-9acd-66b1a95f6b9a tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1501 microversion: 2.1 time: 0.541100 Aug 31 19:26:39.680141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 168/325] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:39 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:39.685863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.699401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.704799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:39.704799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-abcb6989-53b4-4232-8083-cf987ebfaa5c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1408 microversion: 2.20 time: 0.191986 Aug 31 19:26:39.704799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 158/326] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:39 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:26:40.486736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-5116921d-3804-48b8-8c06-dcd4ead2828a req-75100243-ac1d-440d-a53f-0fa9de23457b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf99492-1198-453d-9f3b-f4f8bdbc225a", "tag": "531806c1-a1f4-449c-a1b4-ec4835b2b388"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:40.497595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5116921d-3804-48b8-8c06-dcd4ead2828a req-75100243-ac1d-440d-a53f-0fa9de23457b service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.498165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5116921d-3804-48b8-8c06-dcd4ead2828a req-75100243-ac1d-440d-a53f-0fa9de23457b service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.498654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5116921d-3804-48b8-8c06-dcd4ead2828a req-75100243-ac1d-440d-a53f-0fa9de23457b service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.511080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-5116921d-3804-48b8-8c06-dcd4ead2828a req-75100243-ac1d-440d-a53f-0fa9de23457b service nova] Creating event network-changed:531806c1-a1f4-449c-a1b4-ec4835b2b388 for instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a on hv-cinder-85220 Aug 31 19:26:40.516756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-5116921d-3804-48b8-8c06-dcd4ead2828a req-75100243-ac1d-440d-a53f-0fa9de23457b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033731 Aug 31 19:26:40.517712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 169/327] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:26:40.534617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.536565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.543714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.544435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.545038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.546050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.546715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.547353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.728583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.729454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.751250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.751250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.751250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.751250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.752170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.752170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.752337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.763478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-93e7aaca-c112-44ba-81d1-b3bbc697445b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.232295 Aug 31 19:26:40.765850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 159/328] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:40.939959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.950903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.954056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:40.954819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e8911d2b-3b53-4abd-ae8d-33420d1ee2dc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1601 microversion: 2.20 time: 0.230665 Aug 31 19:26:40.955845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 170/329] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1601 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:26:40.982195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:40.982686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:40.989294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.989786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.990225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:40.990988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:40.991449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:40.991873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.132751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ec98438b-4d00-420c-a753-75f4507f8573 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.152248 Aug 31 19:26:41.133982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 160/330] 10.222.0.59 () {60 vars in 1316 bytes} [Wed Aug 31 19:26:40 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:26:41.786645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:41.787286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:41.798565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.799106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.802065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:41.802811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:41.804647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:41.805282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.103638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:42.111361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-86e8fabf-65c8-44cd-bdb7-6a4a4ff2f09e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.329489 Aug 31 19:26:42.116401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 171/331] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:41 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:42.850707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8a86ac2-cb8a-45e5-80ef-3bfdef7f5f62"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:42.853373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:42.870466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.871394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.872009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.872875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:42.873720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:42.875726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:42.898628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:43.034308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-f78bb8ef-8410-4c52-afcc-d6b27fa617b7 req-bf8e0827-f1d3-49d8-9b5d-a34bab8c8364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:26:43.044915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-f78bb8ef-8410-4c52-afcc-d6b27fa617b7 req-bf8e0827-f1d3-49d8-9b5d-a34bab8c8364 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.045397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-f78bb8ef-8410-4c52-afcc-d6b27fa617b7 req-bf8e0827-f1d3-49d8-9b5d-a34bab8c8364 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.046128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-f78bb8ef-8410-4c52-afcc-d6b27fa617b7 req-bf8e0827-f1d3-49d8-9b5d-a34bab8c8364 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.060262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-f78bb8ef-8410-4c52-afcc-d6b27fa617b7 req-bf8e0827-f1d3-49d8-9b5d-a34bab8c8364 service nova] Creating event network-changed:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:26:43.067013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-f78bb8ef-8410-4c52-afcc-d6b27fa617b7 req-bf8e0827-f1d3-49d8-9b5d-a34bab8c8364 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035593 Aug 31 19:26:43.068458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 172/332] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:43.137412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:43.138113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:43.153458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.154079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.154434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.155175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:43.155636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:43.156061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:43.413945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:43.422213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ea086837-e1d1-41b5-baea-d5a6bd59486a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.288560 Aug 31 19:26:43.422811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 173/333] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:43 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:44.445239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-08d51e59-410f-446d-844f-cea31aa33ee5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "POST /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.598163 Aug 31 19:26:44.446328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 161/334] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:26:42 2022] POST /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b/os-volume_attachments => generated 194 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:26:44.462112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:44.464991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:44.475131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.475633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.476333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.477050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:44.477503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:44.477931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:44.671505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:44.680177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8071e1df-585f-40be-9821-c50f9861324f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.234775 Aug 31 19:26:44.680758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 174/335] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:44 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:45.701734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:45.702848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:45.710470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:45.711121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:45.712396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:45.713164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:45.713629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:45.714088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:46.084642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:46.092557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a9248e4c-3080-47d4-98f0-cdd78a5fc420 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.395755 Aug 31 19:26:46.093123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 162/336] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:45 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:47.114209 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:47.114903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:47.133766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:47.134269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:47.134723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:47.135463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:47.135924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:47.136354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:47.433780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:47.441661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c383c379-d7c5-43e8-98c6-b31f8ffd6b6d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.331325 Aug 31 19:26:47.442344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 175/337] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:47 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:48.463936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:48.464809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:48.472058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.472826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.473486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.474281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:48.482162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:48.482162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:48.656095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:48.666207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d48ee6ff-0e3d-4212-ad30-c8643b1067b4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.207193 Aug 31 19:26:48.666787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 163/338] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:48 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:49.695417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:49.697319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:49.710097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.712262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.714272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.715973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:49.717303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:49.718041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:49.892422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:49.901953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2912c781-07db-49d4-8580-f4ed492adc09 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.214039 Aug 31 19:26:49.903804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 176/339] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:49 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:50.924088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:50.924702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:50.931554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:50.932040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:50.932481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:50.933171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:50.933635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:50.934066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:51.084597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:51.092447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-85017a29-54e5-4a5e-b83b-72fe04b9baa4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.172390 Aug 31 19:26:51.093019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 164/340] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:50 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:52.113575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:52.114186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:52.122763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.122763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.123235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.123995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:52.124459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:52.124894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:52.322627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:52.330430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c66803ac-5c3b-469f-a32e-e7c372a2fb61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.220700 Aug 31 19:26:52.331020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 177/341] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:52 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:53.353280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:53.356078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:53.363372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:53.363864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:53.364296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:53.364998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:53.365999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:53.366643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:53.523400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:53.532901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7cff5859-89b4-49e1-aaad-eb21b9cf6c2a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.184093 Aug 31 19:26:53.534100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 165/342] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:53 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:54.558820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:54.559598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:54.566221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:54.566730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:54.567309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:54.568017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:54.568508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:54.568943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:54.870969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:54.878914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-59978f50-74fe-4cc4-9531-086be8d2d17e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.325812 Aug 31 19:26:54.879479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 178/343] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:54 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:55.476769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:55.479228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:55.484113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.484746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.485255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.486354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.486731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.487400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.518437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:26:55.901041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:55.901656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:55.911650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.912181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.914185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.915565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.917479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:55.918226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:55.968922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-644c3c20-c867-4a6f-b4bf-7a50b97d71b5 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 204 len: 0 microversion: 2.1 time: 0.496712 Aug 31 19:26:55.973542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 166/344] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:26:55 2022] DELETE /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:26:55.980195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:55.981255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:55.998435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:55.999380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:56.000033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:56.000926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:56.001583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:56.002183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:56.309416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:56.321400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-65af22e2-51b3-4c42-99ad-f39d87200236 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.345995 Aug 31 19:26:56.322185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 167/345] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:55 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:56.585225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:56.602637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-21c366c8-a19f-482d-a05b-c730bebd548c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.703020 Aug 31 19:26:56.603365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 179/346] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:55 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:57.346104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:57.346794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:57.359693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:57.362406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:57.362722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.363476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:57.364037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:57.364360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.595469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:57.605587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6bcf12a5-3d61-42ee-aede-6b660c0e3190 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.263484 Aug 31 19:26:57.606639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 168/347] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:57 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:57.625472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:57.626737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:57.634237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:57.644922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:57.644922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.644922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:57.644922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:57.645303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:57.849091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:57.864681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cf8d23ae-7559-4800-bd97-26647654281e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.243545 Aug 31 19:26:57.879705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 180/348] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:57 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:58.630242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:58.631732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:58.634788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:26:58.645153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.646139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.647867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.648745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.649280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.649784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.815150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:58.824215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04784271-a305-4585-afd8-92eabd47f94e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.198202 Aug 31 19:26:58.832182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 169/349] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:58 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:58.887287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:58.888444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:58.898586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.898586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.898586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:58.898586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:58.900177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:58.900842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:59.101559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:26:59.109317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b5f09d3f-0e28-4ee9-bdc8-3fbe64b3d362 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.226331 Aug 31 19:26:59.109885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 181/350] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:58 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:26:59.845740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:26:59.846349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:26:59.854463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:59.855010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:59.855451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:26:59.856324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:26:59.856835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:26:59.857208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:00.016783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:00.033310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3168ce17-a9a2-4519-a4d2-08f47baba13c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.190992 Aug 31 19:27:00.034972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 170/351] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:26:59 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:00.129654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:00.130348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:00.136189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=61 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:00.137901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:00.138544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:00.139366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:00.140561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:00.141329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:00.141768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:00.373527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:00.382161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-558e2973-466e-409f-aa5c-a7e5f29636d0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.256482 Aug 31 19:27:00.382863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 182/352] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:00 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:01.060775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:01.062047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:01.077846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:01.078671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:01.079555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:01.080432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:01.081352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:01.081992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:01.404943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:01.405751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:01.413648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:01.414435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:01.415176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:01.416067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:01.416858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:01.417737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:01.433605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:01.447255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75ecda22-680f-4d8f-a773-c6b08cb0798b tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.394811 Aug 31 19:27:01.448606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 171/353] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:01 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:01.611594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:01.620537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f9708b85-06e0-4be8-895c-6a63c912d04c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.219415 Aug 31 19:27:01.621417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 183/354] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:01 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:02.473250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:02.473939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:02.482712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:02.483472 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:02.484128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:02.484977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:02.485551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:02.486111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:02.644308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:02.644915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:02.656392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:02.656887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:02.657318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:02.658190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:02.660348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:02.662745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:02.763484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:02.778358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c8dde4c1-21f8-40e9-af2d-921f72bfb7d8 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.309845 Aug 31 19:27:02.779093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 172/355] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:02 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:02.853673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:02.853828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3930947d-1a53-4de7-8100-cf5dccc62747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.212866 Aug 31 19:27:02.858679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 184/356] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:02 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:27:03.801563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:03.802093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:03.812929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:03.813799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:03.814593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:03.815546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:03.816878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:03.817599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:03.875642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:03.876921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:03.884744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:03.885539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:03.886292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:03.887406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:03.888109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:03.889382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:03.990544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:04.000514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e3396817-216e-41b3-9480-a6b132562c88 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.203409 Aug 31 19:27:04.014786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 173/357] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:03 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:04.125211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:04.134661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7337fd03-62a7-49da-9fdd-13f0edd3365b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.263035 Aug 31 19:27:04.135444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 185/358] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:03 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:05.024355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:05.029940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:05.032168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:05.032769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:05.033220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:05.033953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:05.034458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:05.034994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:05.157758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:05.158619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:05.166648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:05.167262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:05.167778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:05.168680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:05.169492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:05.170001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:05.199275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:05.201472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:05.206271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:05.209582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0a178116-b3a7-4322-9e27-e1ec2a10a084 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.189789 Aug 31 19:27:05.210807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 174/359] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:05 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:05.380379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:05.390809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-10bd404a-2627-4cca-8449-e908f2b9dab0 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.236578 Aug 31 19:27:05.391226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 186/360] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:05 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:06.049857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6ea832f7-d7aa-4300-b68a-46ec8799efce tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Action: 'create', calling method: .version_select at 0x7ff6cb6eff70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-667416223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfbY3yQKTqbutvxeMkMm+nLsXwOarY0Jal/OExM/8SEf9d9V/gznvvMp3mNXh9pRUvrtke+dFvQ5rN9RgMx3DdRmvh5KlTl9RFe3IMOxV/u2w5lrzJyCR6Cd6pvRVuazg=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:06.065402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6ea832f7-d7aa-4300-b68a-46ec8799efce tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:27:06.069292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6ea832f7-d7aa-4300-b68a-46ec8799efce tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for user be55f0bb21f044b0a8346cf953b1650e and project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:27:06.199803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6ea832f7-d7aa-4300-b68a-46ec8799efce tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.318925 Aug 31 19:27:06.200430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 175/361] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:27:05 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:27:06.237325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:06.238268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:06.254566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:06.255124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:06.255562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:06.256260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:06.256710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:06.257138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:06.412575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:06.413193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:06.434713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:06.435251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:06.435681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:06.436408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:06.436855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:06.437277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:06.508168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:06.524014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-54f29fdb-aa2a-4cf8-8e25-d8fc386b82bb tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1553 microversion: 2.1 time: 0.292737 Aug 31 19:27:06.527199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 187/362] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:06 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:06.992956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:07.001804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-461ad4d0-5c9b-45fa-ba47-c60de49ef573 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.593598 Aug 31 19:27:07.002392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 176/363] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:06 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:07.488030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-b97e9b1c-a5a2-40cc-b062-e0bfba03b711 req-be5f2c97-8392-4eac-9160-36a472c22b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04777b04-7baf-471b-a244-e91bc64cb15b", "name": "network-vif-deleted", "tag": "fedebd72-d0d8-4183-bb59-913256ef56e7"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:07.502148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b97e9b1c-a5a2-40cc-b062-e0bfba03b711 req-be5f2c97-8392-4eac-9160-36a472c22b54 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:07.502632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b97e9b1c-a5a2-40cc-b062-e0bfba03b711 req-be5f2c97-8392-4eac-9160-36a472c22b54 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:07.503180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b97e9b1c-a5a2-40cc-b062-e0bfba03b711 req-be5f2c97-8392-4eac-9160-36a472c22b54 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:07.516689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-b97e9b1c-a5a2-40cc-b062-e0bfba03b711 req-be5f2c97-8392-4eac-9160-36a472c22b54 service nova] Creating event network-vif-deleted:fedebd72-d0d8-4183-bb59-913256ef56e7 for instance 04777b04-7baf-471b-a244-e91bc64cb15b on hv-cinder-85220 Aug 31 19:27:07.523501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-b97e9b1c-a5a2-40cc-b062-e0bfba03b711 req-be5f2c97-8392-4eac-9160-36a472c22b54 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039144 Aug 31 19:27:07.524113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 188/364] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:27:07.553730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:07.554343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:07.569806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:07.573144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:07.573144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:07.573144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:07.573144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:07.573572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:07.819049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:07.827174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c55405b9-8ec9-470c-b503-5090e703e75c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1511 microversion: 2.1 time: 0.280348 Aug 31 19:27:07.827754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 177/365] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:07 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1511 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:08.024415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:08.025118 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:08.032175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.032676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.033119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.033832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.034297 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.034843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.193741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:08.202982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f6fb406c-cb7f-4243-988c-3320b091a3b1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.183354 Aug 31 19:27:08.203651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 189/366] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:08 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:08.849017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:08.852498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:08.860090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.860664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.861174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.861956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.862491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.863132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.901126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:08.901646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:08.902091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:08.902561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lazy-loading 'fault' on Instance uuid 04777b04-7baf-471b-a244-e91bc64cb15b {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:27:08.983083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:08.994218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cba26c85-18ef-49e5-95b6-e800350ec39e tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1351 microversion: 2.1 time: 0.148887 Aug 31 19:27:08.995507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 178/367] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:08 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:09.227844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:09.228462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:09.234839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:09.235556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:09.236231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:09.236947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:09.237409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:09.238065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:09.384935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:09.395301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5bdd9532-fcf0-4513-96a0-73721eb3d345 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.172452 Aug 31 19:27:09.396424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 190/368] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:09 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:10.016759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:10.017368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:10.025015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.025496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.026006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:10.026703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.027198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.027627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:10.059884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.060368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.060801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:10.061238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lazy-loading 'fault' on Instance uuid 04777b04-7baf-471b-a244-e91bc64cb15b {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:27:10.102532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7aaa082f2b754cf5aa941586361c1877', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa8bb54679c74f039eee057c2b4a84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:10.110665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1f08f64c-08d2-4b6a-953c-bb5de316d1c4 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 200 len: 1351 microversion: 2.1 time: 0.097864 Aug 31 19:27:10.111275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 179/369] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:10 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:10.424810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:10.426450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:10.433519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.437739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.437739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:10.437739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:10.437739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:10.438275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:10.610574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:10.619333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bba98745-d5cb-4b02-8a9e-41a650c6684b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.198414 Aug 31 19:27:10.620140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 191/370] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:10 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:11.131329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:11.131979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:11.139362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:11.139854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:11.140303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.141011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:11.141478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:11.142045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.156058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] HTTP exception thrown: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Request method failure captured: Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b HTTP/1.1 Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WUQKV_jlsmKGygL2Z7OXrEiHrAkaEomkQE-Dj-5vAnKy4B6YS7Rh6XKh-wLLpXRmkx72B3ih47blbt9f8YqbWkdfRUibD2Dg89tg9irtu96OOZFoI2MuNHXkGCpnQSrkpXbOPx4IFBbYF85rOazMdk3Pp9V9-P-zlP3ec29JXYiLc Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:27:11.161138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fa8bb54679c74f039eee057c2b4a84f7", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 7aaa082f2b754cf5aa941586361c1877 Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.162749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '04777b04-7baf-471b-a244-e91bc64cb15b'} Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:11.163607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.165139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.166195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Returning 404 to user: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:11.166195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-204a83b0-eb65-4182-8612-b2fe3e691526 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 404 len: 111 microversion: 2.1 time: 0.035896 Aug 31 19:27:11.166195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 180/371] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:11 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:27:11.285309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:11.287834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:11.294326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:11.294826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:11.295307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.296050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:11.296680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:11.297058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.311703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] HTTP exception thrown: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Request method failure captured: Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b/os-volume_attachments HTTP/1.1 Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WUQKV_jlsmKGygL2Z7OXrEiHrAkaEomkQE-Dj-5vAnKy4B6YS7Rh6XKh-wLLpXRmkx72B3ih47blbt9f8YqbWkdfRUibD2Dg89tg9irtu96OOZFoI2MuNHXkGCpnQSrkpXbOPx4IFBbYF85rOazMdk3Pp9V9-P-zlP3ec29JXYiLc Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:27:11.316271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fa8bb54679c74f039eee057c2b4a84f7", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 7aaa082f2b754cf5aa941586361c1877 Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.317797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'server_id': '04777b04-7baf-471b-a244-e91bc64cb15b'} Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:11.324373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:11.325749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:11.327238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Returning 404 to user: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:11.327238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-992df7f1-5609-4249-88d8-4ec9f4e51d33 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043022 Aug 31 19:27:11.329923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 192/372] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:27:11 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:27:11.641982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:11.642756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:11.652867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:11.655996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:11.655996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.655996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:11.655996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:11.656738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:11.821482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:11.842623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-010540ec-50b6-4684-9d18-1f26d9c83233 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.205558 Aug 31 19:27:11.843456 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 181/373] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:11 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:12.868605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:12.869428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:12.883794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:12.884518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:12.884956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:12.885681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:12.886147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:12.886581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:13.021780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:13.030433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8a458ee0-a2af-44b1-947c-53a1fe6d185b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.168408 Aug 31 19:27:13.042949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 193/374] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:12 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:14.053282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:14.053894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:14.060236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.060719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.061153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.061930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.062391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.062844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.267992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:14.276113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-25088f15-50b6-4d80-8c4e-243be7e8c8cc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.226933 Aug 31 19:27:14.276762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 182/375] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:14 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:14.839847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:14.840365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:14.847317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.847813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.848265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.848958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.849418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.849853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.865246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] HTTP exception thrown: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Request method failure captured: Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b HTTP/1.1 Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WUQKV_jlsmKGygL2Z7OXrEiHrAkaEomkQE-Dj-5vAnKy4B6YS7Rh6XKh-wLLpXRmkx72B3ih47blbt9f8YqbWkdfRUibD2Dg89tg9irtu96OOZFoI2MuNHXkGCpnQSrkpXbOPx4IFBbYF85rOazMdk3Pp9V9-P-zlP3ec29JXYiLc Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:27:14.868098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fa8bb54679c74f039eee057c2b4a84f7", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 7aaa082f2b754cf5aa941586361c1877 Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.869857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '04777b04-7baf-471b-a244-e91bc64cb15b'} Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:14.870826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.872296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.874232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Returning 404 to user: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:14.874232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3c478ae5-8a92-4be2-876e-56e84688377c tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 404 len: 111 microversion: 2.1 time: 0.034623 Aug 31 19:27:14.874232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 194/376] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:27:14 2022] DELETE /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:27:14.882153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:14.882785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] [instance: 04777b04-7baf-471b-a244-e91bc64cb15b] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:14.898041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.899517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.900553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.901384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:14.901988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:14.902542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:14.920867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] HTTP exception thrown: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Request method failure captured: Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b HTTP/1.1 Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WUQKV_jlsmKGygL2Z7OXrEiHrAkaEomkQE-Dj-5vAnKy4B6YS7Rh6XKh-wLLpXRmkx72B3ih47blbt9f8YqbWkdfRUibD2Dg89tg9irtu96OOZFoI2MuNHXkGCpnQSrkpXbOPx4IFBbYF85rOazMdk3Pp9V9-P-zlP3ec29JXYiLc Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:27:14.922403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fa8bb54679c74f039eee057c2b4a84f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fa8bb54679c74f039eee057c2b4a84f7", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: fa8bb54679c74f039eee057c2b4a84f7 Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-DeleteServersTestJSON-587330693 Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 7aaa082f2b754cf5aa941586361c1877 Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-DeleteServersTestJSON-587330693-project Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.923804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '04777b04-7baf-471b-a244-e91bc64cb15b'} Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:14.924611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. Aug 31 19:27:14.925753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:27:14.926739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] Returning 404 to user: Instance 04777b04-7baf-471b-a244-e91bc64cb15b could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:14.926739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b45abfe1-3c26-4328-82c1-0f903ed5a885 tempest-DeleteServersTestJSON-587330693 tempest-DeleteServersTestJSON-587330693-project] 10.222.0.59 "GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b" status: 404 len: 111 microversion: 2.1 time: 0.049446 Aug 31 19:27:14.926739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 183/377] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:14 2022] GET /compute/v2.1/servers/04777b04-7baf-471b-a244-e91bc64cb15b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:27:15.298255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:15.298983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:15.306191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:15.309774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:15.309774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:15.309774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:15.309774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:15.310157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:15.555950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:15.567518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-df6cd967-c416-4f3d-a301-de82911568c9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.274415 Aug 31 19:27:15.581221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 195/378] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:15 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:16.591562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:16.592799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:16.595754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=4 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:16.601439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:16.602637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:16.603598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:16.604334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:16.604966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:16.608805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:16.772967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:16.782032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4672e5a5-2e9f-4581-842b-29c1dfcaf4d7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.196912 Aug 31 19:27:16.782755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 184/379] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:16 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:17.803480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:17.805200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:17.812238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:17.813787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:17.814311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:17.815275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:17.816088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:17.817237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:18.164799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:18.175766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8e0993af-7b0e-4ffb-b2dc-4f8b58223f06 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.376109 Aug 31 19:27:18.176522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 196/380] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:17 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:19.213652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:19.214240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:19.241142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:19.241894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:19.243233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:19.245159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:19.246416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:19.247138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:19.477669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:19.485901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-96b71287-d21d-4b68-9002-5b747bd3b8b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.291131 Aug 31 19:27:19.486475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 185/381] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:19 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:20.511578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:20.512817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:20.519973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:20.520394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:20.520839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:20.521750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:20.522215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:20.522647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:20.963581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:20.973295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c4026816-2fbd-4841-a2c5-2589d1368e2f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.467823 Aug 31 19:27:20.973863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 197/382] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:20 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:21.994985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:21.996242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:22.002997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:22.003732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:22.004344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:22.005051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:22.005614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:22.005940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:22.163033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:22.171545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5a180264-a3e7-44d2-857c-5ef2ac3e0ebe tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.180299 Aug 31 19:27:22.172112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 186/383] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:21 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:23.193619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:23.194234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:23.200830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:23.201326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:23.201762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:23.202470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:23.202952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:23.203390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:23.365247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:23.373543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e473a683-433b-49ed-8942-b0dbc59b8ce5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1522 microversion: 2.1 time: 0.183804 Aug 31 19:27:23.374112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 198/384] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:23 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:24.394821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:24.395555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:24.402704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:24.403235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:24.403678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:24.404379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:24.404837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:24.405263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:24.545109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:24.553160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-059aa29d-22c0-4473-ad46-70a9739d6853 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1502 microversion: 2.1 time: 0.162380 Aug 31 19:27:24.553749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 187/385] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:24 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:24.576644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:24.577399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:24.583277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:24.583772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:24.584215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:24.584920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:24.586824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:24.586824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:24.721517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:24.730958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f7ef1792-214b-42df-ad29-751e2ba60307 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1516 microversion: 2.1 time: 0.158123 Aug 31 19:27:24.731530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 199/386] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:24 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:32.953353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:32.955564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:32.957980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:32.963119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:32.965949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:32.965949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:32.965949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:32.965949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:32.966285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:32.989167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'flavor' on Instance uuid df9a1dbe-59be-491e-a129-aba5a3e1fe39 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:27:33.373975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-553129f4-146f-40e9-96de-3e20a7183b88 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/action" status: 200 len: 32 microversion: 2.1 time: 0.424638 Aug 31 19:27:33.374517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 188/387] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:27:32 2022] POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:27:33.384597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:33.385212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:33.387641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=36 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:33.392892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.396659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.396659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.396659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:33.396659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:33.397194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:33.527379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:33.535453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-77ec0ba9-8dd2-4c80-86a8-aed10b64149f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.155256 Aug 31 19:27:33.536108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 200/388] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:33 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:34.557429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:34.558133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:34.564327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:34.564824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:34.565269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:34.565977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:34.566445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:34.566901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:34.700757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:34.708747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-26858f7a-6a16-4fd3-b930-c5bfbbecca3f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.156623 Aug 31 19:27:34.709322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 189/389] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:34 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:35.730842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:35.731624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:35.737905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:35.738472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:35.739047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:35.739836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:35.740367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:35.740939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:35.878182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:35.887003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a84459c-0559-4fcd-9f1e-e81ba5559f3a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.160167 Aug 31 19:27:35.887572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 201/390] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:35 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:36.908533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:36.909176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:36.915732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:36.916233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:36.916669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:36.917381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:36.917839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:36.918260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:37.046638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:37.059419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-79c09869-fbb6-4b77-aade-55d084e2f6b2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.150759 Aug 31 19:27:37.059419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 190/391] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:36 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:38.077245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:38.077851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:38.083738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:38.084215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:38.084660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:38.086117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:38.086567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:38.087132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:38.091084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=81 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:38.218232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:38.226729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f478ad6a-510f-460d-b5aa-41f72494f37d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.153316 Aug 31 19:27:38.227327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 202/392] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:38 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:39.247173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:39.247784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:39.254105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:39.254589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:39.255056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:39.255751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:39.256212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:39.256641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:39.261586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:39.387987 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:39.395535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2f579c91-f582-493d-9d00-ceb6a168cdbb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.152301 Aug 31 19:27:39.396104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 191/393] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:39 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:40.418727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:40.419292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:40.425247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:40.425738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:40.426181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:40.426886 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:40.427363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:40.427796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:40.575849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:40.587601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d6f8d62a-992b-4979-bf1c-065002cffd31 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.172368 Aug 31 19:27:40.587601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 203/394] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:40 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:41.614858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:41.616919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:41.625399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:41.626182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:41.626841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:41.627801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:41.628591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:41.629081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:41.791218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:41.799436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a6e31231-80b9-495f-8386-640bc0440b44 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.194271 Aug 31 19:27:41.800012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 192/395] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:41 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:42.822255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:42.822891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:42.829465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:42.829959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:42.830422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:42.831134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:42.831602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:42.832034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:42.973479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:42.982196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-085c4a22-f840-44a5-9ca7-89a0f13dc900 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.164809 Aug 31 19:27:42.982790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 204/396] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:42 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:44.003707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:44.004266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:44.010751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:44.011271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:44.011740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:44.012420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:44.012843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:44.013264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:44.150028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:44.171429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-57bb6963-6eae-4214-8b82-420425ebe16f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.158213 Aug 31 19:27:44.171429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 193/397] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:43 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:45.181444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:45.182074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:45.188189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:45.188678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:45.189118 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:45.189817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:45.190272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:45.190696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:45.325324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:45.333376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5268d841-ed94-4b4c-a8ea-2424e9ccacdd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.155894 Aug 31 19:27:45.333875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 205/398] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:45 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:46.355448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:46.356295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:46.362686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:46.363196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:46.363631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:46.364315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:46.364809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:46.365172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:46.494247 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:46.502950 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5b1894c6-b24f-4f84-a4f6-270a9dc05532 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.151170 Aug 31 19:27:46.503515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 194/399] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:46 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:47.524718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:47.525285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:47.532158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:47.532660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:47.533111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:47.533820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:47.534282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:47.534714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:47.667403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:47.675540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e78d6821-7926-4cac-bbf6-bf009ec431b3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.155575 Aug 31 19:27:47.676113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 206/400] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:47 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:48.236072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-293980382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-667416223", "security_groups": [{"name": "tempest-secgroup-smoke-130140016"}], "block_device_mapping_v2": [{"uuid": "49c7c6e6-19a0-4fe8-b34b-2d193edc69eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eef987c2-b70a-4b27-b2c6-0c199324cbe1"}]}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:48.394469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] validate_networks() for [('eef987c2-b70a-4b27-b2c6-0c199324cbe1', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:27:48.698466 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:48.699171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:48.710023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:48.710618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:48.715266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:48.715266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:48.715266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:48.715266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:48.818361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:27:48.818805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:27:48.819311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:27:48.819727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:27:48.820141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:27:48.833926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:48.834420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:48.834865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:48.835630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:48.836180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:48.836803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:48.856410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:27:48.860815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for user be55f0bb21f044b0a8346cf953b1650e and project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:27:48.863999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:48.872764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1e8c6fbe-608e-4b02-84e3-528a7df5a9e2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.179184 Aug 31 19:27:48.873343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 207/401] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:48 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:48.928778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:27:48.932277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49c7c6e6-19a0-4fe8-b34b-2d193edc69eb',volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:27:49.844407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-667faeb3-b0d7-4800-8915-3e98b4572aa3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.612322 Aug 31 19:27:49.845081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 195/402] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:27:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:27:49.857820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f29e3235-2b2d-4b99-854d-6ee12af8e0cf tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:49.858551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f29e3235-2b2d-4b99-854d-6ee12af8e0cf tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:49.895214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:49.896034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:49.904379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:49.905003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:49.905546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:49.906514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:49.907237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:49.907883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:49.921771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f29e3235-2b2d-4b99-854d-6ee12af8e0cf tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:49.933497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f29e3235-2b2d-4b99-854d-6ee12af8e0cf tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1093 microversion: 2.1 time: 0.079744 Aug 31 19:27:49.939582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 208/403] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:49 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:50.099620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:50.111093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e00c5fc8-360d-45d6-90b6-cafb88e6457f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.219898 Aug 31 19:27:50.112664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 196/404] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:49 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:27:50.954889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-66cd6456-5727-4f06-9889-d25d617ad48e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:50.955511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-66cd6456-5727-4f06-9889-d25d617ad48e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:51.010937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-66cd6456-5727-4f06-9889-d25d617ad48e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:51.018716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-66cd6456-5727-4f06-9889-d25d617ad48e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1093 microversion: 2.1 time: 0.067752 Aug 31 19:27:51.019314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 209/405] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:50 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:51.139409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:51.140007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:51.146626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.147069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.147505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.148322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.148790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.149932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.290398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:51.298588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bf850270-6208-43b9-a821-bc3e7ef81982 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1502 microversion: 2.1 time: 0.162948 Aug 31 19:27:51.299186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 197/406] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:51 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:51.319793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed3bb1c3-e822-4baa-98d6-ed52b730754c"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:51.322888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:51.328903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.329395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.329841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.330545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.331055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.331549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.355510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] HTTP exception thrown: Cannot 'attach_volume' instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 while it is in vm_state rescued Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Request method failure captured: Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/os-volume_attachments HTTP/1.1 Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 74 Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WTSwqL5fj_-7PvAGhkDP9X0avlP3tH5hgP1Gd7O66yBB0wkk28pRE7tPInpIGra5uwRIYynaiwhRzzvGg9kgRO_iP-S64n-M6Y20jU6uRFHwHZhgawtbK79TbYB6b1a8klLWfVdEeRDE034IIO7toQYxzqsca7JCLsjcVn3uz_AMs Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:27:51.357086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a7e6027f7c1241dcb09786ff94df5c2f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: d441bbdb43c5403abf8480146bc15753 Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {"volumeAttachment": {"volumeId": "ed3bb1c3-e822-4baa-98d6-ed52b730754c"}} Aug 31 19:27:51.358659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Cannot 'attach_volume' instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 while it is in vm_state rescued Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'server_id': 'df9a1dbe-59be-491e-a129-aba5a3e1fe39', 'body': {'volumeAttachment': {'volumeId': 'ed3bb1c3-e822-4baa-98d6-ed52b730754c'}}} Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:27:51.359753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 while it is in vm_state rescued Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:27:51.361215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 while it is in vm_state rescued Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Returning 409 to user: Cannot 'attach_volume' instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 while it is in vm_state rescued {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-46c60f58-3f93-4e46-afdc-cc474d1e27dd tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042799 Aug 31 19:27:51.362715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 210/407] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:27:51 2022] POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:27:51.367658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:51.368394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:51.375188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.376027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.376027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.376850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.377317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.377749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.595510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-33f204e1-b116-4ace-a3d2-208aebbf8201 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/action" status: 202 len: 0 microversion: 2.1 time: 0.231390 Aug 31 19:27:51.596601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 198/408] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:27:51 2022] POST /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:27:51.606813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:51.608828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:51.617120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.618004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.618564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.619350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:51.619813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:51.620439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:51.808662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:51.822707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a315463-635f-41ad-a960-ddaea0563211 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1510 microversion: 2.1 time: 0.221574 Aug 31 19:27:51.831540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 211/409] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:51 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:52.042985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:52.050489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:52.053112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:52.053618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:52.054082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:52.054795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:52.055317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:52.055934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:52.136725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:52.144964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67cb2b6e-c8d0-40c0-817f-2657a3ba7280 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1191 microversion: 2.1 time: 0.108890 Aug 31 19:27:52.145535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 199/410] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:52 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:52.846103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:52.846722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:52.857734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:52.860799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:52.860799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:52.860799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:52.860799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:52.861235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:53.013389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:53.023604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d9a9170d-f124-4568-89ef-3da5b1eb661c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1510 microversion: 2.1 time: 0.181586 Aug 31 19:27:53.024966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 212/411] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:52 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:53.166512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:53.167244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:53.175981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:53.176602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:53.177121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:53.177836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:53.178297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:53.178724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:53.342601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:53.355819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-64d4551f-0ea3-4eec-952c-636b5e861737 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1209 microversion: 2.1 time: 0.192629 Aug 31 19:27:53.357696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 200/412] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:53 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1209 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:54.046311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:54.046965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:54.060803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:54.060803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:54.060803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:54.060803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:54.061271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:54.061271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:54.236864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:54.247744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-500f3dc4-1cfa-42a7-b17a-abe53550e37e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1510 microversion: 2.1 time: 0.205331 Aug 31 19:27:54.248405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 213/413] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:54 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:54.378004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:54.378624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:54.386970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:54.387474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:54.387921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:54.388652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:54.389108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:54.389540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:54.539188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:54.553542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cf2303dc-ae54-4356-b917-d776a2fa8dac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1276 microversion: 2.1 time: 0.179658 Aug 31 19:27:54.555736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 201/414] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:54 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:55.272652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:55.273259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:55.282181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:55.283053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:55.284424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:55.285304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:55.286060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:55.286685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:55.440109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:55.448559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-94a1a074-620c-4365-8ef6-5b1db303c359 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1510 microversion: 2.1 time: 0.179540 Aug 31 19:27:55.449167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 214/415] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:55 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:55.577758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:55.578368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:55.584898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:55.585392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:55.585840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:55.587134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:55.587600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:55.588032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:55.767253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-28c3fd1c-3316-4384-997c-74161706aa09 req-3ac568fe-ec7e-420c-9df7-6fadee8fd0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd04ea9-23ba-4968-9801-39230f724ace", "tag": "9656ec16-53d3-4a35-9c76-08e64beac219"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:55.773567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:55.782548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-28c3fd1c-3316-4384-997c-74161706aa09 req-3ac568fe-ec7e-420c-9df7-6fadee8fd0f7 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:55.783533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-28c3fd1c-3316-4384-997c-74161706aa09 req-3ac568fe-ec7e-420c-9df7-6fadee8fd0f7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:55.784230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-28c3fd1c-3316-4384-997c-74161706aa09 req-3ac568fe-ec7e-420c-9df7-6fadee8fd0f7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:55.785790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-65039d18-9727-42c0-a752-b71aa13f3ff3 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1276 microversion: 2.1 time: 0.211717 Aug 31 19:27:55.798738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 202/416] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:55 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:55.812482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-28c3fd1c-3316-4384-997c-74161706aa09 req-3ac568fe-ec7e-420c-9df7-6fadee8fd0f7 service nova] Creating event network-changed:9656ec16-53d3-4a35-9c76-08e64beac219 for instance dfd04ea9-23ba-4968-9801-39230f724ace on hv-cinder-85220 Aug 31 19:27:55.819009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-28c3fd1c-3316-4384-997c-74161706aa09 req-3ac568fe-ec7e-420c-9df7-6fadee8fd0f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061227 Aug 31 19:27:55.819943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 215/417] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:27:56.481713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:56.482332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:56.490307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:56.490800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:56.491265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:56.492119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:56.492813 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:56.493142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:56.751516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:56.768402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cd2f3812-ed62-4293-a748-fe865937560c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1516 microversion: 2.1 time: 0.293629 Aug 31 19:27:56.768402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 203/418] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:56 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:56.811865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:56.812626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:56.823315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:56.823832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:56.824379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:56.825276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:56.825908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:56.826346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:56.979666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:56.987675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f5046359-a042-44b1-a2fd-7b626c3962dc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1276 microversion: 2.1 time: 0.180251 Aug 31 19:27:56.988244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 216/419] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:56 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:58.010024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:58.010685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:58.017056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:58.017544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:58.017999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:58.018696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:58.019176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:58.019602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:58.158783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:58.167001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2df356cb-423a-4d47-a036-1577d88334bc tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.161199 Aug 31 19:27:58.167581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 204/420] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:58 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:59.187658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:27:59.188264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:27:59.194195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:59.194674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:59.195146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:59.195836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:27:59.196361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:27:59.196975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:27:59.332495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:27:59.341003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fd6eb5fd-b82b-40f0-900d-05dd642afd5a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.157080 Aug 31 19:27:59.341577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 217/421] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:27:59 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:27:59.729661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-996740ff-4d2d-43df-a136-3319f6067262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'create', calling method: .version_select at 0x7ff6cb5ef940>, body: {"keypair": {"name": "tempest-keypair-1559696521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBfu5w8V3USw/+UofRZC7ED4gipYjBWad58BnzcJYh2+YCbKeUS1cnrHK+UNcGCAdPT8QsZ6Tl+hPH9Vc5YlrAof/ltPHVwitda4UFrYli656WMqZ3PgzhfjXEXcS/Ejg=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:27:59.736545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:59.737390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:27:59.753641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-996740ff-4d2d-43df-a136-3319f6067262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:27:59.758042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-996740ff-4d2d-43df-a136-3319f6067262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for user d441bbdb43c5403abf8480146bc15753 and project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:27:59.850514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-996740ff-4d2d-43df-a136-3319f6067262 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124944 Aug 31 19:27:59.851313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 205/422] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:27:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:00.363769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:00.364380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:00.371205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:00.371696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:00.372319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:00.373226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:00.373694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:00.374130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:00.548328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:00.558196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8a149ebd-0fae-4b4b-b935-22502135f9c5 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.198275 Aug 31 19:28:00.558817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 218/423] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:00 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:01.581520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:01.581520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:01.589815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:01.590299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:01.590733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:01.591466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:01.591939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:01.592350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:01.824949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:01.833297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d6a84323-12c1-4a45-aae5-8fda0554802f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.257072 Aug 31 19:28:01.833865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 206/424] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:01 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:02.728289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2001661550", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e413f1b1-2e66-4271-87c8-7a5825a65e8e"}], "security_groups": [{"name": "tempest-securitygroup--1249763370"}], "key_name": "tempest-keypair-1559696521", "user_data": "}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:02.738402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=4 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:02.832052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] validate_networks() for [('e413f1b1-2e66-4271-87c8-7a5825a65e8e', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:28:02.857493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:02.859345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:02.875351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:02.876126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:02.878175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:02.879171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:02.879818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:02.880264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:03.038511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:03.049013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b62ba33c-06c0-4030-9f38-5b933bbcad7b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.195222 Aug 31 19:28:03.049611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 207/425] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:02 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:03.254272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:28:03.254702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:28:03.255316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:28:03.255732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:28:03.256184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:28:03.267898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:03.268415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:03.268855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:03.269854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:03.270419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:03.270979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:03.289832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:28:03.296592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Getting quotas for user d441bbdb43c5403abf8480146bc15753 and project a7e6027f7c1241dcb09786ff94df5c2f. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:28:03.308757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:28:03.311698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:28:03.491117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d9bf26e3-1a54-41cf-901b-2401f834ac6c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.766963 Aug 31 19:28:03.491767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 219/426] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:28:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:28:03.503792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e6e54125-5f19-4fc1-ae9b-26c47e58bcd2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:03.504537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e6e54125-5f19-4fc1-ae9b-26c47e58bcd2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:03.506429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:03.574993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e6e54125-5f19-4fc1-ae9b-26c47e58bcd2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:03.584008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e6e54125-5f19-4fc1-ae9b-26c47e58bcd2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1246 microversion: 2.1 time: 0.084253 Aug 31 19:28:03.585183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 208/427] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:03 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:04.072583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:04.073192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:04.075120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:04.080081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:04.080568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:04.081007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:04.081774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:04.082267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:04.082696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:04.222447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:04.233362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f9aa75e3-db2a-445c-ab58-cf24bb74ed49 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.164630 Aug 31 19:28:04.234031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 220/428] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:04 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:04.615057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:04.615850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:04.622718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:04.623560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:04.624011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:04.624713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:04.625171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:04.625598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:04.643675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:04.691192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:04.707053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cea7a19b-6b56-4671-b87f-08aaeec75cd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1250 microversion: 2.1 time: 0.088812 Aug 31 19:28:04.707053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 209/429] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:04 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:05.255456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:05.255977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:05.262788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:05.263315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:05.263759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:05.264458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:05.264915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:05.265341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:05.406940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:05.414828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-794c13d9-3e08-43e8-a400-dced5e779d03 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.163984 Aug 31 19:28:05.415620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 221/430] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:05 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:05.726709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:05.727940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:05.735440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:05.735907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:05.736346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:05.737128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:05.737619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:05.738051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:05.806716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:05.814768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-311371e7-b243-45fe-9abb-c00cc91b94e3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1250 microversion: 2.1 time: 0.092857 Aug 31 19:28:05.815358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 210/431] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:05 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1250 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:06.436374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:06.437072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:06.443840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:06.444464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:06.445071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:06.447121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:06.447796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:06.448242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:06.465858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:06.590651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:06.599174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f8cddc34-b93c-414f-b81e-d53dab9c5964 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.166663 Aug 31 19:28:06.599842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 222/432] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:06 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:06.835711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:06.836442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:06.843660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:06.844149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:06.847236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:06.847236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:06.847236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:06.847236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:06.921687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:06.934277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fe5fa485-d899-4151-a9d9-cd3752814df9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1242 microversion: 2.1 time: 0.102463 Aug 31 19:28:06.939282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 211/433] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:06 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:07.619203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:07.619805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:07.625673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:07.626169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:07.626592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:07.627338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:07.627760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:07.628186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:07.765603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:07.773651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-725b454c-76a4-4e40-b790-ac68b60aa950 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.158223 Aug 31 19:28:07.774642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 223/434] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:07 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:07.955576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:07.956306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:07.963401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:07.963924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:07.964362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:07.965066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:07.965578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:07.966011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:08.030128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:08.037903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c36bd2ce-c66a-4e81-8f34-2787e2bbaa5f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1298 microversion: 2.1 time: 0.086361 Aug 31 19:28:08.038468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 212/435] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:07 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:08.796346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:08.796869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:08.802926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:08.803415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:08.803850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:08.804546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:08.805066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:08.805584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:08.942520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:08.951806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0fdcff2d-b824-479c-a094-c1d54af01031 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.158849 Aug 31 19:28:08.952382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 224/436] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:08 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:09.069002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:09.069747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:09.076506 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:09.076993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:09.077626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:09.078430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:09.078935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:09.079362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:09.285822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:09.294099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9e17fb66-2a6a-46a4-b5ad-5964a6c50185 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.229059 Aug 31 19:28:09.294908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 213/437] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:09 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:09.973935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:09.974549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:09.981680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:09.982244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:09.982729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:09.983541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:09.984053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:09.984526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:10.079705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-8edc6995-3722-48c8-a122-d141a474def7 req-0f51fee1-bb6c-439e-afad-07157287c5aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfd4317-2f4a-492d-a077-f5a77c2fc9e6", "tag": "3b5690b6-4b17-4483-8488-59210ca2f88f"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:10.090235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-8edc6995-3722-48c8-a122-d141a474def7 req-0f51fee1-bb6c-439e-afad-07157287c5aa service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:10.091259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-8edc6995-3722-48c8-a122-d141a474def7 req-0f51fee1-bb6c-439e-afad-07157287c5aa service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:10.091848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-8edc6995-3722-48c8-a122-d141a474def7 req-0f51fee1-bb6c-439e-afad-07157287c5aa service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:10.106758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-8edc6995-3722-48c8-a122-d141a474def7 req-0f51fee1-bb6c-439e-afad-07157287c5aa service nova] Creating event network-changed:3b5690b6-4b17-4483-8488-59210ca2f88f for instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 on hv-cinder-85220 Aug 31 19:28:10.116425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-8edc6995-3722-48c8-a122-d141a474def7 req-0f51fee1-bb6c-439e-afad-07157287c5aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040369 Aug 31 19:28:10.118029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 214/438] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:10.130039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:10.138750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-599a764c-d75d-41e7-a09e-c69201bb645c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.168928 Aug 31 19:28:10.139362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 225/439] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:09 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:10.320034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:10.320735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:10.327000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:10.327494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:10.327931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:10.328633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:10.329090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:10.329518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:10.534367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:10.543383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d8efb824-b1dc-49ca-960c-b5dbd29d8254 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.227510 Aug 31 19:28:10.543992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 215/440] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:10 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:11.160331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:11.160940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:11.168731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.169731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.170177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.170895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.171904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.172341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.263093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-3dfac17a-d395-4492-a8ba-8cf810246e70 req-aed21c99-d9f4-42f7-a4bd-2d84fa5fdaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd04ea9-23ba-4968-9801-39230f724ace", "name": "network-vif-plugged", "status": "completed", "tag": "9656ec16-53d3-4a35-9c76-08e64beac219"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:11.272994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3dfac17a-d395-4492-a8ba-8cf810246e70 req-aed21c99-d9f4-42f7-a4bd-2d84fa5fdaa8 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.273609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3dfac17a-d395-4492-a8ba-8cf810246e70 req-aed21c99-d9f4-42f7-a4bd-2d84fa5fdaa8 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.274763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3dfac17a-d395-4492-a8ba-8cf810246e70 req-aed21c99-d9f4-42f7-a4bd-2d84fa5fdaa8 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.288625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-3dfac17a-d395-4492-a8ba-8cf810246e70 req-aed21c99-d9f4-42f7-a4bd-2d84fa5fdaa8 service nova] Creating event network-vif-plugged:9656ec16-53d3-4a35-9c76-08e64beac219 for instance dfd04ea9-23ba-4968-9801-39230f724ace on hv-cinder-85220 Aug 31 19:28:11.294227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-3dfac17a-d395-4492-a8ba-8cf810246e70 req-aed21c99-d9f4-42f7-a4bd-2d84fa5fdaa8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035405 Aug 31 19:28:11.294850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 216/441] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:28:11.321892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:11.329717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3bc44d64-0b99-4c0c-8d32-93e6c3cba5c0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.173416 Aug 31 19:28:11.330292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 226/442] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:11 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:11.784726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:11.784726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:11.784726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.784726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.785610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.785610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:11.785610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:11.785610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:11.786593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:11.786593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dba37872-1393-4270-8849-7e5b98bdcafa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.160177 Aug 31 19:28:11.786593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 217/443] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:11 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:12.351548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:12.352166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:12.358611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:12.359130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:12.359579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:12.360300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:12.360767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:12.361199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:12.496275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:12.504086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cebf6dd6-b7fe-4ddb-ad47-d1c67e24e816 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.156794 Aug 31 19:28:12.504650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 227/444] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:12 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:12.741710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:12.742356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:12.749263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:12.750467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:12.750467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:12.750939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:12.751823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:12.751823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:12.890377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:12.898354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f76fc277-b55c-43f4-92ca-318b4cc083b8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.160562 Aug 31 19:28:12.898957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 218/445] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:12 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:13.526370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:13.526929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:13.528765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:13.529443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:13.534322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:13.534818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:13.535299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:13.535998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:13.536466 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:13.536901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:13.672267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:13.679943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8917bb5e-6354-4fac-92be-7f8208a84884 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.158249 Aug 31 19:28:13.680520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 228/446] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:13 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:13.920155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:13.920901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:13.923125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:13.928058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:13.928625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:13.929168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:13.929879 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:13.930343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:13.930775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:14.107792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:14.115994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d42a2e3b-3203-4a38-bfb4-1134d833abf5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.199611 Aug 31 19:28:14.116573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 219/447] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:13 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:14.701023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:14.701692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:14.708191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:14.708676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:14.709108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:14.709801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:14.710252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:14.710673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:14.848400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:14.857194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c736b061-7a82-4155-9785-d58ebe5da47b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.160773 Aug 31 19:28:14.857691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 229/448] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:14 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:15.139621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:15.140384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:15.147028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.147615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.148145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:15.148924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.149462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.150519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:15.304192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:15.312406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f97bc602-8c3a-4531-a0c1-a3ff0fd54f43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.176764 Aug 31 19:28:15.312986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 220/449] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:15 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:15.877397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:15.878019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:15.884461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.885018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.885458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:15.886161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:15.886630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:15.887096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:16.023659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:16.032805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bf0b538-8a8c-4f20-89ef-0f1b2f3c0028 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.159242 Aug 31 19:28:16.034922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 230/450] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:15 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:16.333597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:16.334210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:16.341602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:16.342098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:16.342536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:16.343276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:16.343728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:16.348017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:16.482471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:16.499608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-720fc890-54e3-4ee2-ac1b-b0aa45ccf77e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.165782 Aug 31 19:28:16.499608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 221/451] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:16 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:17.055420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:17.056786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:17.062429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:17.062849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:17.063343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:17.064037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:17.064493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:17.064914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:17.202550 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:17.210727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-965db284-f51c-45c0-bda1-70dbbfe9ccd1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.159072 Aug 31 19:28:17.211654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 231/452] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:17 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:17.519387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:17.520006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:17.526725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:17.527457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:17.527856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:17.528633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:17.529105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:17.529561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:17.663419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:17.671946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1a968d83-7f76-41aa-a571-ea0e303dfdec tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.156516 Aug 31 19:28:17.672515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 222/453] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:17 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:18.232878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:18.233490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:18.239717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.240272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.240711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.241465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.241942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.242404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.377016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:18.385650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-099afde7-f1db-40b2-b326-9e2574107b81 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.156627 Aug 31 19:28:18.386223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 232/454] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:18 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:18.691774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-1ec88505-1afc-476a-80f3-ba195b9559eb req-56d03d7b-d9d2-4102-8ea6-f6fbe679bdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfd4317-2f4a-492d-a077-f5a77c2fc9e6", "name": "network-vif-plugged", "status": "completed", "tag": "3b5690b6-4b17-4483-8488-59210ca2f88f"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:18.693414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:18.693969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:18.700655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.701153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.701574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-1ec88505-1afc-476a-80f3-ba195b9559eb req-56d03d7b-d9d2-4102-8ea6-f6fbe679bdc1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.701732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.702060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-1ec88505-1afc-476a-80f3-ba195b9559eb req-56d03d7b-d9d2-4102-8ea6-f6fbe679bdc1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.702291 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:18.702492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-1ec88505-1afc-476a-80f3-ba195b9559eb req-56d03d7b-d9d2-4102-8ea6-f6fbe679bdc1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.702753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:18.703215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:18.715912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-1ec88505-1afc-476a-80f3-ba195b9559eb req-56d03d7b-d9d2-4102-8ea6-f6fbe679bdc1 service nova] Creating event network-vif-plugged:3b5690b6-4b17-4483-8488-59210ca2f88f for instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 on hv-cinder-85220 Aug 31 19:28:18.720833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-1ec88505-1afc-476a-80f3-ba195b9559eb req-56d03d7b-d9d2-4102-8ea6-f6fbe679bdc1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032876 Aug 31 19:28:18.721424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 223/455] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:18.840602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:18.848572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bedf8b5-a6c6-4f9a-a3cf-d92203b043fa tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.159133 Aug 31 19:28:18.849132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 233/456] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:18 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:19.406363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:19.407090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:19.413715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.414203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.414744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.415524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.415981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.416571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.554376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:19.563100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5e49bd98-8af6-4c54-a1cc-b641b798f6b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1264 microversion: 2.1 time: 0.161008 Aug 31 19:28:19.563808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 224/457] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:19 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:19.870180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:19.870784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:19.876774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.877257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.877693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:19.878397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:19.878835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:19.879288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.007344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:20.015419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c09abd21-6fe4-4097-a170-b8bcb38c7d85 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.149673 Aug 31 19:28:20.015988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 234/458] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:19 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:20.468291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1450911144", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:20.528424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] validate_networks() for None {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:28:20.584629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:20.585245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:20.596011 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:20.601556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:20.601556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.601556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:20.601556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:20.601908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.769400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:20.778794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-341300a9-75cd-444b-87da-3ec2f959d73f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1451 microversion: 2.1 time: 0.197577 Aug 31 19:28:20.779437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 235/459] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:20 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:20.801385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:20.801999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:20.808357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:20.808855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:20.809292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.809999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:20.810494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:20.810952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.850114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:28:20.850546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:28:20.851076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:28:20.851481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:28:20.851938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:28:20.862061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:20.862554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:20.863038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.863791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:20.864257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:20.864691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:20.882293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Getting quotas for project 92ef41f677d24d69ae37d2c206497d6f. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:28:20.886641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Getting quotas for user c440fa0ce8e6445f8381f0bb74213057 and project 92ef41f677d24d69ae37d2c206497d6f. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:28:20.898434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:28:20.901340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:28:20.969616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:20.978122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5d57c9b9-581f-4a3d-945d-dbc1a2c8799a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1451 microversion: 2.1 time: 0.180561 Aug 31 19:28:20.978772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 236/460] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:20 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:21.038555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:21.039820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:21.047522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:21.048305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:21.048930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:21.049654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:21.050270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:21.051162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6d38e39a-7a37-4f82-b683-b1338fc52ca4 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586328 Aug 31 19:28:21.057531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:21.057705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 225/461] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:28:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:28:21.076045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c123bde4-22c6-412a-b21c-ce826f4bd3b7 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:21.077651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c123bde4-22c6-412a-b21c-ce826f4bd3b7 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:21.163695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c123bde4-22c6-412a-b21c-ce826f4bd3b7 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:21.172760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c123bde4-22c6-412a-b21c-ce826f4bd3b7 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1215 microversion: 2.1 time: 0.107410 Aug 31 19:28:21.173709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 226/462] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:21 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:21.232733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:21.242528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9590f2e3-949a-4bd3-ad87-c50adfd352bf tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.209303 Aug 31 19:28:21.243596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 237/463] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:21 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:22.196436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-05580f82-740f-4e8b-b416-6ed8704f45a3 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:22.197059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-05580f82-740f-4e8b-b416-6ed8704f45a3 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:22.268422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:22.269641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:22.279824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:22.280609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:22.281132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:22.282918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:22.283800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:22.284592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:22.421878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-05580f82-740f-4e8b-b416-6ed8704f45a3 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:22.426721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:22.429526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-05580f82-740f-4e8b-b416-6ed8704f45a3 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1215 microversion: 2.1 time: 0.237564 Aug 31 19:28:22.430538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 227/464] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:22 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:22.434862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-647903e1-2e09-4078-81b3-1205aab7b4f7 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1372 microversion: 2.1 time: 0.170669 Aug 31 19:28:22.435671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 238/465] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:22 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:23.432988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-783d4f82-8c59-49bd-9f02-78f85fc2f8c1 req-5e57d75f-9644-473d-8130-5c6fd3a8f0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd04ea9-23ba-4968-9801-39230f724ace", "tag": "9656ec16-53d3-4a35-9c76-08e64beac219"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:23.451725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:23.452991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-783d4f82-8c59-49bd-9f02-78f85fc2f8c1 req-5e57d75f-9644-473d-8130-5c6fd3a8f0d5 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.453673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-783d4f82-8c59-49bd-9f02-78f85fc2f8c1 req-5e57d75f-9644-473d-8130-5c6fd3a8f0d5 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.454139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-783d4f82-8c59-49bd-9f02-78f85fc2f8c1 req-5e57d75f-9644-473d-8130-5c6fd3a8f0d5 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.458638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:23.466863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-783d4f82-8c59-49bd-9f02-78f85fc2f8c1 req-5e57d75f-9644-473d-8130-5c6fd3a8f0d5 service nova] Creating event network-changed:9656ec16-53d3-4a35-9c76-08e64beac219 for instance dfd04ea9-23ba-4968-9801-39230f724ace on hv-cinder-85220 Aug 31 19:28:23.470418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.473384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.473831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.474155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-783d4f82-8c59-49bd-9f02-78f85fc2f8c1 req-5e57d75f-9644-473d-8130-5c6fd3a8f0d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046580 Aug 31 19:28:23.474568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.475061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.475489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.478537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:23.478905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 228/466] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:23.485406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:23.486104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:23.493544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.494391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.494841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.495580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.496091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.496672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.545522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:23.554449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-333d8f47-2161-40fb-8d68-72a93d24dfda tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1267 microversion: 2.1 time: 0.107645 Aug 31 19:28:23.555253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 239/467] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:23 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1267 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:28:23.736300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:23.743200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e79d1369-8506-4e3a-a057-41705a499091 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1567 microversion: 2.1 time: 0.262497 Aug 31 19:28:23.744582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 229/468] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:23 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:23.766059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:23.766562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:23.772643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.773135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.773577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.774380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:23.774828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:23.775287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:23.872811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-016a2801-a28c-4e20-af84-75a423d9167e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110624 Aug 31 19:28:23.873396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 240/469] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:28:23 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:24.580602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:24.581382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:24.589838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:24.590720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:24.591294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:24.592127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:24.592665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:24.593176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:24.934469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:24.949144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-35c8a260-12f6-4f0d-b85d-4a5c33d328dd tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1275 microversion: 2.1 time: 0.372797 Aug 31 19:28:24.950132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 230/470] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:24 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:25.693651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-c7b5ee8c-23a3-4978-a19e-e6891b18f4ff req-336d5fc3-3f63-4da1-a560-2994f354cefe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfd4317-2f4a-492d-a077-f5a77c2fc9e6", "tag": "3b5690b6-4b17-4483-8488-59210ca2f88f"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:25.703967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-c7b5ee8c-23a3-4978-a19e-e6891b18f4ff req-336d5fc3-3f63-4da1-a560-2994f354cefe service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:25.704452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-c7b5ee8c-23a3-4978-a19e-e6891b18f4ff req-336d5fc3-3f63-4da1-a560-2994f354cefe service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:25.704940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-c7b5ee8c-23a3-4978-a19e-e6891b18f4ff req-336d5fc3-3f63-4da1-a560-2994f354cefe service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:25.719924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-c7b5ee8c-23a3-4978-a19e-e6891b18f4ff req-336d5fc3-3f63-4da1-a560-2994f354cefe service nova] Creating event network-changed:3b5690b6-4b17-4483-8488-59210ca2f88f for instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 on hv-cinder-85220 Aug 31 19:28:25.722643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-c7b5ee8c-23a3-4978-a19e-e6891b18f4ff req-336d5fc3-3f63-4da1-a560-2994f354cefe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032779 Aug 31 19:28:25.724683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 241/471] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:25.974760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:25.975510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:25.982612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:25.983433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:25.983896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:25.984752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:25.985694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:25.986161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:26.002607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:26.087496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:26.098486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9d00de47-b656-4855-938c-c36b1f894c78 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1273 microversion: 2.1 time: 0.129447 Aug 31 19:28:26.099835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 231/472] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:25 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:27.125166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:27.125874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:27.132176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:27.133269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:27.133729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:27.134448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:27.135110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:27.135768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:27.282441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:27.291360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bada5ee2-2c51-40dd-8e43-48f08f62da22 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.170374 Aug 31 19:28:27.304997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 242/473] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:27 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:27.739851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-e385cd3a-314f-4292-bcb3-d4be8cef13ce req-59ccc577-bf78-454c-9740-21246df04d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10673e0f-140c-40a1-92cf-264bbc4059f6", "tag": "04e7c626-ff7b-4041-97a1-82c501db56eb"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:27.750773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-e385cd3a-314f-4292-bcb3-d4be8cef13ce req-59ccc577-bf78-454c-9740-21246df04d1c service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:27.751148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-e385cd3a-314f-4292-bcb3-d4be8cef13ce req-59ccc577-bf78-454c-9740-21246df04d1c service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:27.751578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-e385cd3a-314f-4292-bcb3-d4be8cef13ce req-59ccc577-bf78-454c-9740-21246df04d1c service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:27.762662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-e385cd3a-314f-4292-bcb3-d4be8cef13ce req-59ccc577-bf78-454c-9740-21246df04d1c service nova] Creating event network-changed:04e7c626-ff7b-4041-97a1-82c501db56eb for instance 10673e0f-140c-40a1-92cf-264bbc4059f6 on hv-cinder-85220 Aug 31 19:28:27.767693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-e385cd3a-314f-4292-bcb3-d4be8cef13ce req-59ccc577-bf78-454c-9740-21246df04d1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031524 Aug 31 19:28:27.768549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 232/474] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:28.312566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:28.313197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:28.319147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:28.319636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:28.320110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:28.320840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:28.321303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:28.321737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:28.451378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:28.459137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-48065501-f3f7-4631-81f4-8a4ae4299012 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.150420 Aug 31 19:28:28.459698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 243/475] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:28 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:29.483325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:29.484037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:29.490570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:29.491101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:29.491564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:29.492344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:29.492799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:29.493224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:29.629259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:29.637100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5c7fb95b-0d87-4550-b0df-1272c4181ae2 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.159908 Aug 31 19:28:29.637667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 233/476] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:29 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:30.657810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:30.658425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:30.664501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:30.664992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:30.665438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:30.666139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:30.666601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:30.667770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:30.799649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:30.807484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2ba77744-1444-4070-89df-07eb68ba0e41 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.153582 Aug 31 19:28:30.808362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 244/477] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:30 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:31.828550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:31.829199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:31.831668 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:31.836563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:31.837054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:31.837498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:31.838235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:31.843805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:31.843805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:32.372391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:32.380089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-15217985-9880-47b6-a09e-bde6af2471f6 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.555469 Aug 31 19:28:32.380655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 234/478] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:31 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:33.401065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:33.401668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:33.409419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:33.409903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:33.410338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:33.411060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:33.411513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:33.411966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:33.565985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:33.573811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3151a94e-bb8b-447e-b587-9b1b8ee07125 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.176598 Aug 31 19:28:33.574537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 245/479] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:33 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:34.596291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:34.596909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:34.599023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=10 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:34.604859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:34.605344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:34.606805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:34.607620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:34.608085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:34.609005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:34.743148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:34.751129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4da4c850-c20a-4b64-9ed2-a22e80384191 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.158648 Aug 31 19:28:34.751692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 235/480] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:34 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:35.108005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-c061bf4a-56c7-407e-adb7-4fe74a06593b req-bb9a8f01-991a-4eec-ab2d-dfc3ba9053d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10673e0f-140c-40a1-92cf-264bbc4059f6", "name": "network-vif-plugged", "status": "completed", "tag": "04e7c626-ff7b-4041-97a1-82c501db56eb"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:35.114044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:28:35.114210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:28:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.59) !!! Aug 31 19:28:35.129822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-c061bf4a-56c7-407e-adb7-4fe74a06593b req-bb9a8f01-991a-4eec-ab2d-dfc3ba9053d4 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:35.130548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-c061bf4a-56c7-407e-adb7-4fe74a06593b req-bb9a8f01-991a-4eec-ab2d-dfc3ba9053d4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:35.131052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-c061bf4a-56c7-407e-adb7-4fe74a06593b req-bb9a8f01-991a-4eec-ab2d-dfc3ba9053d4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:35.144367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-c061bf4a-56c7-407e-adb7-4fe74a06593b req-bb9a8f01-991a-4eec-ab2d-dfc3ba9053d4 service nova] Creating event network-vif-plugged:04e7c626-ff7b-4041-97a1-82c501db56eb for instance 10673e0f-140c-40a1-92cf-264bbc4059f6 on hv-cinder-85220 Aug 31 19:28:35.149616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-c061bf4a-56c7-407e-adb7-4fe74a06593b req-bb9a8f01-991a-4eec-ab2d-dfc3ba9053d4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045502 Aug 31 19:28:35.150487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 246/481] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:35.773474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:35.775218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:35.785504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:35.786985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:35.787478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:35.787948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:35.788846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:35.789304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:35.789732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:35.936953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:35.945255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bd24ebc9-e99f-4ff2-a098-f8a11ac1a6f8 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.176586 Aug 31 19:28:35.945890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 236/482] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:35 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:36.967811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:36.968541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:36.970962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=54 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:36.987724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:36.988504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:36.989148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:36.990771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:36.991489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:36.991937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:37.193870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:37.203492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-05475cd7-5ac8-49aa-9763-ef847ba92e98 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.240229 Aug 31 19:28:37.204065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 247/483] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:36 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:38.225288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:38.225957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:38.233081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:38.233573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:38.234019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:38.234726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:38.235224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:38.235661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:38.482493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:38.491291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3aeb37fe-bb48-49c5-8d82-6fe0492fd7ad tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1315 microversion: 2.1 time: 0.270344 Aug 31 19:28:38.492485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 237/484] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:38 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:39.513635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:39.514248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:39.520501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:39.520988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:39.521432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:39.522138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:39.522596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:39.523060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:39.663187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:39.675382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dbefff3c-58fd-4dd5-87e4-04b9bf56891b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1464 microversion: 2.1 time: 0.165990 Aug 31 19:28:39.677239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 248/485] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:39 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1464 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:39.732442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:39.732979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:39.739974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:39.740469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:39.740906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:39.741617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:39.742072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:39.742500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:39.769561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:28:40.063957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bb6cf7f5-abf0-4e08-aaaa-745702ce9957 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "DELETE /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 204 len: 0 microversion: 2.1 time: 0.336099 Aug 31 19:28:40.064542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 238/486] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:28:39 2022] DELETE /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:28:40.073156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:40.073858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:40.080343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:40.080822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:40.081261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:40.081956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:40.082468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:40.082922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:40.225654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:40.234719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0d956f26-e3b0-45c4-89ad-4f47ab675e4a tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1470 microversion: 2.1 time: 0.165605 Aug 31 19:28:40.235363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 249/487] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:40 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1470 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:41.256444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:41.257828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:41.265603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:41.266092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:41.266529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:41.271581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:41.271581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:41.271581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:41.432243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:41.441291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-31e619bb-36bf-4357-af4f-5e1839f05e1e tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1470 microversion: 2.1 time: 0.189089 Aug 31 19:28:41.455214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 239/488] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:41 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:42.463390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:42.465227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:42.472340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:42.473057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:42.473510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:42.474230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:42.474850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:42.475319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:42.668310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:42.687527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7555173c-271a-4af6-8f8f-26e88cac654b tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1470 microversion: 2.1 time: 0.229574 Aug 31 19:28:42.688305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 250/489] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:42 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:43.349090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-80b3be8c-5239-4382-b634-a1cccf447e9b req-e63995bc-7368-43c4-8962-a9dca25d650c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10673e0f-140c-40a1-92cf-264bbc4059f6", "name": "network-vif-deleted", "tag": "04e7c626-ff7b-4041-97a1-82c501db56eb"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:43.375614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-80b3be8c-5239-4382-b634-a1cccf447e9b req-e63995bc-7368-43c4-8962-a9dca25d650c service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:43.376554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-80b3be8c-5239-4382-b634-a1cccf447e9b req-e63995bc-7368-43c4-8962-a9dca25d650c service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:43.377223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-80b3be8c-5239-4382-b634-a1cccf447e9b req-e63995bc-7368-43c4-8962-a9dca25d650c service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:43.407220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-80b3be8c-5239-4382-b634-a1cccf447e9b req-e63995bc-7368-43c4-8962-a9dca25d650c service nova] Creating event network-vif-deleted:04e7c626-ff7b-4041-97a1-82c501db56eb for instance 10673e0f-140c-40a1-92cf-264bbc4059f6 on hv-cinder-85220 Aug 31 19:28:43.416288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-80b3be8c-5239-4382-b634-a1cccf447e9b req-e63995bc-7368-43c4-8962-a9dca25d650c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071809 Aug 31 19:28:43.426137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 240/490] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:43.719250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:43.720614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:43.732992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:43.733406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:43.733849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:43.734563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:43.738666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:43.741332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:43.782243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:43.783079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:43.783888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:43.784343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lazy-loading 'fault' on Instance uuid 10673e0f-140c-40a1-92cf-264bbc4059f6 {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:28:43.856525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c440fa0ce8e6445f8381f0bb74213057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ef41f677d24d69ae37d2c206497d6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:43.870347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e3df8b24-5c90-4eb5-a80f-dd216b29f6ff tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 200 len: 1305 microversion: 2.1 time: 0.155607 Aug 31 19:28:43.873341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 251/491] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:43 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 1305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:44.897829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:44.898609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] [instance: 10673e0f-140c-40a1-92cf-264bbc4059f6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:44.909962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:44.910772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:44.911416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:44.912299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:44.912913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:44.913498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:44.932864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] HTTP exception thrown: Instance 10673e0f-140c-40a1-92cf-264bbc4059f6 could not be found. Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Request method failure captured: Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 HTTP/1.1 Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7ZQ0cL25L0O0OinjWVgMjSpoDel-wYf8Vz452QwzLLBM3nm1sbdXF6VPX5Kol06XVQ4-yECGMMb5LV6ixABxFGm0hH8tQ7fal6nhyBz5aIU46bFMQDVyveJZNula6S44NZ9rtUz8Uk8IBeU9d1cB9qNzlTByZhtP3dkEzVGRHKQYW4 Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 92ef41f677d24d69ae37d2c206497d6f Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-VolumesNegativeTest-1116211396 Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:28:44.936056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92ef41f677d24d69ae37d2c206497d6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/92ef41f677d24d69ae37d2c206497d6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/92ef41f677d24d69ae37d2c206497d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_92ef41f677d24d69ae37d2c206497d6f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-VolumesNegativeTest-1116211396 Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 92ef41f677d24d69ae37d2c206497d6f Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-VolumesNegativeTest-1116211396 Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-VolumesNegativeTest-1116211396-project Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: c440fa0ce8e6445f8381f0bb74213057 Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-VolumesNegativeTest-1116211396-project Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 10673e0f-140c-40a1-92cf-264bbc4059f6 could not be found. Aug 31 19:28:44.937658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '10673e0f-140c-40a1-92cf-264bbc4059f6'} Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10673e0f-140c-40a1-92cf-264bbc4059f6 could not be found. Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:28:44.944755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10673e0f-140c-40a1-92cf-264bbc4059f6 could not be found. Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10673e0f-140c-40a1-92cf-264bbc4059f6 could not be found. Aug 31 19:28:44.947792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:28:44.949416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] Returning 404 to user: Instance 10673e0f-140c-40a1-92cf-264bbc4059f6 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:28:44.949416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92920f94-fe25-4930-9b69-cbf201c8e6a5 tempest-VolumesNegativeTest-1116211396 tempest-VolumesNegativeTest-1116211396-project] 10.222.0.59 "GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6" status: 404 len: 111 microversion: 2.1 time: 0.046637 Aug 31 19:28:44.949416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 241/492] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:44 2022] GET /compute/v2.1/servers/10673e0f-140c-40a1-92cf-264bbc4059f6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:28:57.522794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:57.523454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:57.525539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=11 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:57.526250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=69 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:57.531086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:57.531576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:57.532023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:57.532722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:57.533176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:57.533604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:57.560004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1f083d84-1725-498d-82e1-896a76b4ef5a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/ips" status: 200 len: 145 microversion: 2.1 time: 0.041034 Aug 31 19:28:57.560735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 252/493] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:28:57 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:57.571385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7c342ec1-c6bb-47ef-b720-ee64cb8092ec tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Action: 'create', calling method: .version_select at 0x7ff6cb6305e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-214267471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLYvEh5UTCUQ1LC+OO9ljY5iqbwsBzJUXE0qvRPcnQyLYDVFjhJosvQRSHvx2Hw2pJFIO5q1PW6zn3lPWXDdEqndh/QonGIFMSbYK8JoF3BEdVD32y2OBUzIyyUxIHh5g=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:57.578802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:57.579495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:28:57.591703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-7c342ec1-c6bb-47ef-b720-ee64cb8092ec tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Getting quotas for project b59a32b67fde4526bbb78d6e0a1cebda. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:28:57.595579 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-7c342ec1-c6bb-47ef-b720-ee64cb8092ec tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Getting quotas for user ca526289756647429b819f466da8941f and project b59a32b67fde4526bbb78d6e0a1cebda. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:28:57.687331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7c342ec1-c6bb-47ef-b720-ee64cb8092ec tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.119550 Aug 31 19:28:57.687937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 242/494] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:28:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:28:57.788614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-302859219", "imageRef": "ae5f1213-0799-4690-9a9c-7dca0c39ec2d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-214267471", "networks": [{"uuid": "0d4aad2f-1839-40b2-9369-5ee2726f982e"}]}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:28:57.842387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] validate_networks() for [('0d4aad2f-1839-40b2-9369-5ee2726f982e', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:28:58.210458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:28:58.210902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:28:58.211379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:28:58.211784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:28:58.212189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:28:58.221921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:58.222394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:58.222822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:58.223574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:58.224027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:58.224451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:58.242377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Getting quotas for project b59a32b67fde4526bbb78d6e0a1cebda. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:28:58.246421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Getting quotas for user ca526289756647429b819f466da8941f and project b59a32b67fde4526bbb78d6e0a1cebda. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:28:58.257240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:28:58.259452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae5f1213-0799-4690-9a9c-7dca0c39ec2d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:28:58.397489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-792064b3-f2e5-43d5-a9bd-126a2558c1d5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613135 Aug 31 19:28:58.398062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 253/495] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:28:58.411700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e41d3cd9-272c-4919-9582-4adbc130a68d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:58.412319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e41d3cd9-272c-4919-9582-4adbc130a68d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:58.478530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e41d3cd9-272c-4919-9582-4adbc130a68d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:58.489335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e41d3cd9-272c-4919-9582-4adbc130a68d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1257 microversion: 2.1 time: 0.081034 Aug 31 19:28:58.489335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 243/496] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:58 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:59.508158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8879f79a-e050-4b42-a1d0-8f39f5601ff1 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:59.508844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8879f79a-e050-4b42-a1d0-8f39f5601ff1 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:59.564259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8879f79a-e050-4b42-a1d0-8f39f5601ff1 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:28:59.571261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8879f79a-e050-4b42-a1d0-8f39f5601ff1 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1257 microversion: 2.1 time: 0.067055 Aug 31 19:28:59.571831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 254/497] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:28:59 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:28:59.906155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:28:59.906155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:28:59.914011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:59.914596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:59.915160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:59.915949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:28:59.916500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:28:59.917966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:28:59.942841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7c81c519-38d5-4a44-9614-b2480caa1bbc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/ips" status: 200 len: 153 microversion: 2.20 time: 0.042938 Aug 31 19:28:59.943453 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 244/498] 10.222.0.59 () {60 vars in 1289 bytes} [Wed Aug 31 19:28:59 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:29:00.592395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:00.593211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:00.599766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:00.600256 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:00.600704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:00.601427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:00.602205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:00.602503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:00.687159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:00.693922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7521956b-3cc6-47be-88bf-f4362b4db35a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1309 microversion: 2.1 time: 0.105925 Aug 31 19:29:00.694640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 255/499] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:00 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:01.716525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:01.717657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:01.727760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:01.728677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:01.730249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:01.731568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:01.732416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:01.733217 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:01.882129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:01.892381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7862ac68-2df0-4d8b-9d01-449ea1cab6e9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1315 microversion: 2.1 time: 0.180878 Aug 31 19:29:01.893390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 245/500] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:01 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:01.958580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3500c7f6-713b-4545-ab91-caf55b169ded"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:01.961029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:01.968795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:01.968795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:01.969086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:01.969865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:01.970208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:01.970634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:02.926005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:02.926604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:02.933527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:02.942154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:02.942154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:02.942154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:02.942154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:02.942551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:03.072564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:03.081153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f5d6b040-399a-4cc7-845d-f4501611af3f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.158917 Aug 31 19:29:03.081725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 246/501] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:02 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:03.386617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:03.386925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:03.392966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:03.393463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:03.393910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:03.394629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:03.395120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:03.395560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:03.421602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lazy-loading 'flavor' on Instance uuid e6b4eccf-f5b2-4847-8f27-6202e7c2a81a {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:29:03.864544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7418f4e2-cba3-474d-bcad-703844bb3792 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/action" status: 202 len: 0 microversion: 2.20 time: 0.482684 Aug 31 19:29:03.865146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 247/502] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 31 19:29:03 2022] POST /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 19:29:03.874304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:03.877025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:03.881452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:03.881945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:03.882388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:03.883140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:03.883653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:03.884086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:04.028181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:04.042368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:04.043859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:04.045044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-58a0d1f5-85bb-4477-8bce-b911b2658edb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.175482 Aug 31 19:29:04.045607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 248/503] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:03 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:04.102143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:04.102888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:04.109868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:04.110360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:04.110805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:04.111606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:04.112075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:04.112507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:04.247393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:04.255205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75f24102-080a-46e9-b64e-a46dfe27d877 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.156969 Aug 31 19:29:04.255777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 249/504] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:04 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:05.069155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:05.069857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:05.077197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:05.077674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:05.078112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:05.078798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:05.079276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:05.079698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:05.217420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:05.226532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:05.228300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:05.230227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3081ed69-486d-4a74-ae42-4297149102de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.165140 Aug 31 19:29:05.230950 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 250/505] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:05 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:05.277097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:05.277504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:05.284501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:05.285005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:05.285452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:05.286167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:05.286625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:05.287087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:05.429263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:05.439504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d71bd857-875c-4d67-820e-b39dbb03fed5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.167748 Aug 31 19:29:05.440283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 251/506] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:05 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:06.252713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:06.253491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:06.267826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:06.268332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:06.268766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:06.269993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:06.269993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:06.270864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:06.406497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:06.415854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:06.418347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:06.419189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-97fc4749-ec58-464e-94c0-138559fa91de tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.170353 Aug 31 19:29:06.419959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 252/507] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:06 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:06.462092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:06.462706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:06.468997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:06.469482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:06.469930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:06.470629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:06.471385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:06.471818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:06.611036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:06.618828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9e159a6c-33b1-4b4b-ad73-2b83de1763ad tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.160798 Aug 31 19:29:06.619420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 253/508] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:06 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:07.442380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:07.443124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:07.450629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:07.451158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:07.451603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:07.452400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:07.452869 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:07.453304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:07.592932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:07.601279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:07.602764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:07.603950 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-70b7ace7-26cf-48b2-a20d-72eb072f157f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.165659 Aug 31 19:29:07.605050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 254/509] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:07 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:07.639377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:07.641797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:07.645956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:07.646524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:07.647181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:07.647918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:07.648401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:07.648836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:07.795357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:07.802918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-41c139b7-b7db-49a8-8bd4-cd4c2b7902b0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.167774 Aug 31 19:29:07.803494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 255/510] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:07 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:08.232175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:08.628240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:08.628868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:08.631332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:08.636371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:08.641789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:08.641789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:08.641789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:08.641789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:08.642144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:08.801807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:08.801807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:08.802049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:08.802049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8d786c05-fb7e-463c-9902-35fd254dba9b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.164622 Aug 31 19:29:08.802049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 256/511] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:08 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:08.824641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:08.825440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:08.831766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:08.832256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:08.832699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:08.833553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:08.834011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:08.834434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:08.966680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:08.974758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-918467cc-3a53-4ad4-a753-1e0a9c064070 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.154657 Aug 31 19:29:08.975357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 257/512] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:08 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:09.568891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=8 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:09.816905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:09.817627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:09.826433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:09.827026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:09.827524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:09.828348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:09.828939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:09.829516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:09.972616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:09.976010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:09.981221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:09.983793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:09.983946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-12507ab1-2e48-4a94-9c75-5c668e2b5227 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.171977 Aug 31 19:29:09.984373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 258/513] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:09 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:10.002378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:10.003120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:10.010248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:10.011275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:10.011864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:10.012776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:10.013238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:10.013696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:10.145951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:10.153888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a2ee0aaa-4833-425f-8b46-8d144e58529b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.161215 Aug 31 19:29:10.154654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 259/514] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:09 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:11.010201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:11.011966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:11.022719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:11.023437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:11.024047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:11.025071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:11.025769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:11.026378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:11.220360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:11.230075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:11.231948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:11.233212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-55f7ad41-3e61-44e9-9b43-4ac56b84f5a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.230122 Aug 31 19:29:11.234289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 260/515] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:11 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:11.238912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:11.269718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:11.269718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:11.269718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:11.269718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:11.270121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:11.270121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:11.270121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:11.391038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:11.407763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-301d150a-0a5e-4ffe-a08c-cb064c6239d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.172232 Aug 31 19:29:11.408352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 261/516] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:11 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:11.965982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:12.048695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=18 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:12.256849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:12.257529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:12.264836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:12.265533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:12.266104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:12.266916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:12.267465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:12.267969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:12.415230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:12.425224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:12.426924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:12.428142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-69b81589-db9c-4d9e-b258-e8ae2fff9a22 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.175247 Aug 31 19:29:12.429060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 262/517] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:12 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:12.434508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:12.437014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:12.442219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:12.442722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:12.443319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:12.444015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:12.444484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:12.444921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:12.579131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:12.586797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0b6be3ce-f72e-4785-a511-e65f2c320120 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.157126 Aug 31 19:29:12.587396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 263/518] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:12 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:13.452908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:13.453671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:13.462150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:13.462651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:13.463177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:13.463962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:13.464766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:13.465208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:13.597770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:13.607788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:13.609235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:13.610490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-24c9ee85-9759-4e83-88e8-c026cda152eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.163035 Aug 31 19:29:13.611122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 264/519] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:13 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:13.622895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:13.622895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:13.625612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:13.628928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:13.628928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:13.628928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:13.628928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:13.629329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:13.777444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:13.785407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c41f85d3-7501-4035-8d9d-e51c703049ea tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.173266 Aug 31 19:29:13.785985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 265/520] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:13 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:14.638218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:14.638924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:14.645437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:14.645927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:14.646393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:14.647200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:14.647666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:14.648100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:14.783935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:14.792631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:14.794069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:14.795269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a24f6b9c-fc32-43cd-9eb7-2a104b9769d7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.162113 Aug 31 19:29:14.795822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 266/521] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:14 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:14.806348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:14.809961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:14.813530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:14.814074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:14.814528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:14.815263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:14.815771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:14.816237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:14.950400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:14.958006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a65701af-424b-48d1-8404-85908abf310c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.155343 Aug 31 19:29:14.958571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 267/522] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:14 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:15.818004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:15.818699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:15.825670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:15.826164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:15.826608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:15.827405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:15.827870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:15.828305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:15.958395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:15.966546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:15.968034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:15.969196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f352d458-3ef9-4a58-a034-daad7b85612b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.155440 Aug 31 19:29:15.969749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 268/523] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:15 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:15.978994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:15.980118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:15.986039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:15.986527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:15.986998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:15.987693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:15.988153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:15.988621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:16.116753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:16.124600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e7cee260-e82e-4ad7-b7b6-0fca1be0a7f9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.149069 Aug 31 19:29:16.125163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 269/524] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:15 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:16.993263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:16.993974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:17.000948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:17.001436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:17.001882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:17.002589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:17.003128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:17.003561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:17.135142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:17.144123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:17.155282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:17.155282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-14f5db8f-a9d3-49d4-b582-538b06ef830d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.157510 Aug 31 19:29:17.155282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 270/525] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:16 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:17.155282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:17.155650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:17.158540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:17.159065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:17.159509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:17.160223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:17.160664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:17.161147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:17.291389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:17.299882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9779c465-05c7-4a88-afc4-51498c57ef37 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.151508 Aug 31 19:29:17.300442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 271/526] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:17 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:18.171095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:18.171900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:18.181548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:18.184353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:18.184353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:18.184353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:18.184353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:18.184736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:18.452562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:18.460560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:18.462015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:18.463377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-874f503a-ff06-427d-8103-154dc4b16777 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.297505 Aug 31 19:29:18.475137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 272/527] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:18 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:18.479185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:18.479846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:18.485871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:18.486356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:18.486791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:18.487506 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:18.488158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:18.488381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:18.700349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d5d19b05-1df1-40fb-9d85-bbc85d4cd426 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.745890 Aug 31 19:29:18.715776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 256/528] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:29:01 2022] POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-volume_attachments => generated 194 bytes in 16756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:29:18.814984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:18.823508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e3e30a13-8583-4b3f-9ebc-a1fa5e331446 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.357969 Aug 31 19:29:18.824225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 273/529] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:18 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:19.194588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-b4a8a55b-dd1d-4063-8c6a-405efb1b1d6e req-883a7ef4-ee46-44d6-a960-3583580e71a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:19.205371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b4a8a55b-dd1d-4063-8c6a-405efb1b1d6e req-883a7ef4-ee46-44d6-a960-3583580e71a4 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.205772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b4a8a55b-dd1d-4063-8c6a-405efb1b1d6e req-883a7ef4-ee46-44d6-a960-3583580e71a4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.206236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b4a8a55b-dd1d-4063-8c6a-405efb1b1d6e req-883a7ef4-ee46-44d6-a960-3583580e71a4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.217062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-b4a8a55b-dd1d-4063-8c6a-405efb1b1d6e req-883a7ef4-ee46-44d6-a960-3583580e71a4 service nova] Creating event network-changed:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:29:19.221848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-b4a8a55b-dd1d-4063-8c6a-405efb1b1d6e req-883a7ef4-ee46-44d6-a960-3583580e71a4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032092 Aug 31 19:29:19.222439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 257/530] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:19.486262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:19.488002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:19.495335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.495828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.496617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.497422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.497881 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.498328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.706165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:19.714627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:19.716205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:19.717330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-44e8ece9-df89-406d-a680-4842d15bd162 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.234979 Aug 31 19:29:19.718214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 274/531] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:19 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:19.846000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:19.846700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:19.852865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.853347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.853789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.855207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:19.855601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:19.856031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:19.990321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:19.998293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-74e857c6-bd72-4151-bbc7-fa3e59532d35 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.156983 Aug 31 19:29:19.998853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 258/532] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:19 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:20.741717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:20.742380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:20.749187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:20.749715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:20.750158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:20.750864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:20.751348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:20.751778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:20.770406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:20.888143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:20.896767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:20.898040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:20.899270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-188204e4-d619-4a93-8fb2-4a725554dff3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.161460 Aug 31 19:29:20.899827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 275/533] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:20 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:21.019333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:21.019994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:21.027389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:21.027840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:21.028281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:21.028989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:21.029437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:21.029859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:21.162745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:21.170439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5570efdb-ccf1-416d-8224-bba3382ac9f7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.154996 Aug 31 19:29:21.171017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 259/534] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:21 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:21.923660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:21.924271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:21.935366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:21.935366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:21.935366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:21.935366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:21.935721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:21.935721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:22.071152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:22.079480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:22.080928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:22.083778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-146e2c4d-212a-4fca-8abe-ba3d5655f764 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.163941 Aug 31 19:29:22.084359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 276/535] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:21 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:22.192294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:22.193033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:22.199214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:22.199701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:22.200144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:22.200878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:22.201382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:22.201814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:22.342649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:22.351601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3f8f1540-be11-4a8e-a743-5a2ad3777f14 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.164081 Aug 31 19:29:22.352182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 260/536] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:22 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:23.110802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:23.111457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:23.117833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:23.118315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:23.118757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:23.120088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:23.120550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:23.120984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:23.253867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:23.262285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:23.263851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:23.265003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-86a492d6-eba2-4cb1-ad59-59f4f589f490 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.158113 Aug 31 19:29:23.265555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 277/537] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:23 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:23.374339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:23.374991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:23.381681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:23.382242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:23.382686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:23.383409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:23.383863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:23.384284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:23.517585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:23.525441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d5e854aa-36b6-47f5-8185-b624bc625e0d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.155929 Aug 31 19:29:23.526207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 261/538] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:23 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:24.287574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:24.288187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:24.294753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:24.295279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:24.295723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:24.296434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:24.296899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:24.297335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:24.428442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:24.436521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:24.437961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:24.439153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f269abeb-c9d8-4508-b81a-4c176dfd7dd0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.155460 Aug 31 19:29:24.439705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 278/539] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:24 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:24.547530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:24.548139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:24.554599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:24.555116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:24.555553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:24.556246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:24.556708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:24.557135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:24.689050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:24.696697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-24e6a4fb-5962-4f30-9de7-7af0bf6a9c03 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.153700 Aug 31 19:29:24.697299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 262/540] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:24 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:25.461215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:25.461868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:25.469422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:25.469919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:25.470611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:25.471381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:25.471848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:25.472283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:25.605007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:25.613391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:25.614982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:25.616142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-98bfb2b7-5701-4f82-a42a-e85881f54586 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.158964 Aug 31 19:29:25.616812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 279/541] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:25 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:25.717133 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:25.717736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:25.724936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:25.725416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:25.725851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:25.726549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:25.727032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:25.727459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:25.858069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:25.866322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-51dce2cb-b4e5-4cad-a33b-a7161663bbfc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.153035 Aug 31 19:29:25.866892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 263/542] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:25 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:26.638439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:26.648836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:26.648836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:26.648836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:26.648836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:26.649253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:26.649253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:26.649253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:26.782641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:26.790964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:26.792371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:26.793511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9a97ede5-02c2-4f07-9f54-2f9ec10d043f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.158931 Aug 31 19:29:26.794069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 280/543] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:26 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:26.886998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:26.887617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:26.894140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:26.894622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:26.895256 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:26.895980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:26.896444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:26.901048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.027042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:27.034728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d98958c8-f9cd-4331-9e2d-9530e61eefd0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.151588 Aug 31 19:29:27.035238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 264/544] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:26 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:27.299423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-711ef0ab-d2c8-4c18-9b65-93df45caa092 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:27.299804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-711ef0ab-d2c8-4c18-9b65-93df45caa092 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.300289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-711ef0ab-d2c8-4c18-9b65-93df45caa092 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.300724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-711ef0ab-d2c8-4c18-9b65-93df45caa092 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.360734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-711ef0ab-d2c8-4c18-9b65-93df45caa092 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Going to try to stop instance {{(pid=121187) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 19:29:27.551794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-711ef0ab-d2c8-4c18-9b65-93df45caa092 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action" status: 202 len: 0 microversion: 2.1 time: 0.262226 Aug 31 19:29:27.552296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 281/545] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:29:27 2022] POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:29:27.560397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:27.561045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:27.567117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.567599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.568076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.568843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.569374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.569800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.706115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:27.714894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f9deb916-77bb-4c8a-b742-f34ccd996b2a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.158257 Aug 31 19:29:27.715469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 265/546] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:27 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:27.817972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:27.818527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:27.824613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.825108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.826806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.827561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.828060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.828990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.866537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-990926d1-84f0-48b2-802b-3b6fcdd5ed0c req-aeb3ad33-7ce8-446a-ae9f-19081f9966a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "name": "network-vif-plugged", "status": "completed", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:27.876527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-990926d1-84f0-48b2-802b-3b6fcdd5ed0c req-aeb3ad33-7ce8-446a-ae9f-19081f9966a8 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:27.876989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-990926d1-84f0-48b2-802b-3b6fcdd5ed0c req-aeb3ad33-7ce8-446a-ae9f-19081f9966a8 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:27.877413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-990926d1-84f0-48b2-802b-3b6fcdd5ed0c req-aeb3ad33-7ce8-446a-ae9f-19081f9966a8 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:27.888707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-990926d1-84f0-48b2-802b-3b6fcdd5ed0c req-aeb3ad33-7ce8-446a-ae9f-19081f9966a8 service nova] Creating event network-vif-plugged:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:29:27.894641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-990926d1-84f0-48b2-802b-3b6fcdd5ed0c req-aeb3ad33-7ce8-446a-ae9f-19081f9966a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Aug 31 19:29:27.895278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 266/547] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:27.962175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:27.971744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:27.973205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:27.974407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c1cf3c61-a7b2-4d24-91e5-ddbe4fbebc14 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.161515 Aug 31 19:29:27.974998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 282/548] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:27 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:28.056955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:28.057759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:28.065201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:28.065690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:28.066135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:28.066928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:28.067405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:28.067835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:28.204721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:28.212345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f2951278-91f7-4af3-97e1-e9793b87ee6a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.159719 Aug 31 19:29:28.213010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 267/549] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:28 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:28.738007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:28.738540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:28.740688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:28.745590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:28.746083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:28.746596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:28.747297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:28.747760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:28.748189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:28.883742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:28.892576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-034ca8af-c1ab-4bee-bb95-564857c9ff62 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.159320 Aug 31 19:29:28.893155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 283/550] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:28 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:28.998910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:28.999446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:29.005914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.006390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.006821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.007559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.007995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.008618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.143449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:29.151666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:29.153086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:29.154232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cb350f1b-315c-402c-b7bd-e6f2ea20657e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.159322 Aug 31 19:29:29.154791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 268/551] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:28 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:29.233587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:29.234197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:29.241732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.242198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.242641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.243404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.243886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.244317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.381337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:29.389350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-07c19f05-c923-4f0c-ab71-572a19f7b513 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1357 microversion: 2.1 time: 0.159649 Aug 31 19:29:29.389948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 284/552] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:29 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:29.913484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:29.914092 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:29.920277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.920790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.921230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:29.922065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:29.922529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:29.922993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.060233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.069360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3bcae077-4336-412b-956b-a7355a5cfa10 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.159703 Aug 31 19:29:30.070033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 269/553] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:29 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:30.177348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:30.177963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:30.184343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.184829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.185269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.185967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.186427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.186859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.410098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:30.410857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:30.417154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.417746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.418259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.419070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.419530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.419962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.562103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.572551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.575598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b7116fb7-dae6-476c-a50c-a51f861543f0 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1547 microversion: 2.1 time: 0.169696 Aug 31 19:29:30.576185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 270/554] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:30 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:30.582664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.584139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.585414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-362f46ff-2931-44d4-875b-ec9488ad5a2e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.411858 Aug 31 19:29:30.585987 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 285/555] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:30 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:30.598332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:30.598995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:30.605569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.606056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.606498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.607279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.607846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.608278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.743146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.751818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9406b542-7f78-481b-9e41-d09000c40cf5 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1547 microversion: 2.1 time: 0.158152 Aug 31 19:29:30.752380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 271/556] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:30 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:30.770964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:30.775850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:30.776555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Searching by: {'deleted': False, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda'} {{(pid=121187) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 19:29:30.783302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.783784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.785904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.785904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.785904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.785904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.877780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.multi_cell_list [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121187) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 19:29:30.973157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fee85ffe-99fa-41c3-8f49-ab3757092e9b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205848 Aug 31 19:29:30.974816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 286/557] 10.222.0.59 () {58 vars in 1125 bytes} [Wed Aug 31 19:29:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:30.985228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:30.985828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:30.991760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.992241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.992677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:30.993367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:30.993820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:30.994243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.091174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:31.091859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:31.099511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:31.099992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:31.100431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.101176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:31.101633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:31.102064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.136139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:31.144260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3675d977-53e7-4c9b-b213-a9086d01d85d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1547 microversion: 2.1 time: 0.163332 Aug 31 19:29:31.144841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 272/558] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:30 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:31.245892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:31.254071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dff76f3a-e5da-4406-aaa1-ec9d285a37dd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.166975 Aug 31 19:29:31.254639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 287/559] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:31 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:31.610048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:31.610661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:31.616671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:31.617157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:31.617640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.618344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:31.618804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:31.619264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:31.638532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:31.755300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:31.763979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:31.765399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:31.766746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ae8b89e5-617d-4dca-81d6-0ea3fa3069d4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.161043 Aug 31 19:29:31.767325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 273/560] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:31 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:32.275340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:32.275995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:32.283135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:32.283619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:32.284055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:32.284748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:32.285202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:32.285627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:32.423618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:32.431974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cd5b7d7d-7ce4-423c-9cd5-eb42f0e01846 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.160460 Aug 31 19:29:32.432529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 288/561] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:32 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:32.789993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:32.790563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:32.797363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:32.797856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:32.801916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:32.801916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:32.801916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:32.801916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:32.930351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:32.939052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:32.940510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:32.941682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-01a557a7-726c-4717-b188-351b0ad17504 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.155985 Aug 31 19:29:32.942228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 274/562] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:32 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:33.453631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:33.454364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:33.460893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:33.465706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:33.465706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:33.465706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:33.465706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:33.466099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:33.592661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:33.601657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-224d0ddb-1bda-4f15-8d7a-a5d5717336fa tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.152552 Aug 31 19:29:33.602233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 289/563] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:33 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:33.964962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:33.965582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:33.973141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:33.973918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:33.974113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:33.974823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:33.975321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:33.975750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:34.112336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:34.124554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:34.126721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:34.127925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-67eddc47-3318-45d7-9966-6dfbe5463322 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.166951 Aug 31 19:29:34.128482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 275/564] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:33 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:34.175771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0275cff0-138a-471f-b014-01299d74c10b"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:34.178227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:34.184096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:34.184601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:34.185036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:34.185714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:34.186161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:34.186585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:34.256012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:34.625947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:34.626306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:34.632820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:34.633420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:34.633870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:34.634576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:34.635072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:34.635509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:34.768001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:34.776120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c8880084-4b8e-4e25-86a0-528b07a5de0a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.155389 Aug 31 19:29:34.776739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 276/565] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:34 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:29:35.031376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d55e933d-cd73-4cbc-8b14-ebe710cf2c33 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859222 Aug 31 19:29:35.031991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 290/566] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:29:34 2022] POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:29:35.151290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:35.152220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:35.158680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:35.159203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:35.159647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:35.160497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:35.160961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:35.161389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:35.292770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:35.301800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:35.303320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:35.304512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-53c97fe6-83f8-4833-8f36-a284e055a818 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.157754 Aug 31 19:29:35.305062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 277/567] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:35 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:35.798253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:35.799040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:35.805864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:35.806301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:35.806750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:35.807545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:35.808031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:35.808466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:35.942901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:35.951227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4d30dba6-e289-4f80-9e9c-9944b3c5b3c6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.158604 Aug 31 19:29:35.951792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 291/568] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:35 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:36.327409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:36.328711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:36.335147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:36.335633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:36.336073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:36.336776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:36.337237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:36.337668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:36.470081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:36.478123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:36.479609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:36.480755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5052bb53-5cd1-450d-a6c2-4dd0bd4b5a69 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.157209 Aug 31 19:29:36.481308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 278/569] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:36 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:36.974452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:36.975079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:36.981499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:36.981986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:36.982432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:36.983163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:36.983628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:36.984057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:37.120600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:37.129239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-08cd901e-7495-408e-89c0-33b12d26e974 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.158642 Aug 31 19:29:37.129805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 292/570] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:36 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:37.504775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:37.505411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:37.511916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:37.512405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:37.512847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:37.513554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:37.514013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:37.514447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:37.646615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:37.653312 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:37.654822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:37.656061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-45a40faf-b03f-41cf-b40e-1ec729854f0a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.155149 Aug 31 19:29:37.656858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 279/571] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:37 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:38.151503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:38.152066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:38.158688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:38.161846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:38.161846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:38.161846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:38.161846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:38.162220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:38.297232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:38.306830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67f18c30-aea1-402c-af4e-7bf529edf47d tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.159577 Aug 31 19:29:38.307446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 293/572] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:38 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:38.679290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:38.679911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:38.686572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:38.687104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:38.687547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:38.688543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:38.689043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:38.689482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:38.834593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:38.842691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:38.844213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:38.846412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e7ed16b6-1453-4646-ba71-b3ff62c6ca61 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.171133 Aug 31 19:29:38.846990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 280/573] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:38 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:39.329620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:39.330244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:39.336733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.337217 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.337652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:39.338344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.338798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.339257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:39.476690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:39.484819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-95c43d32-de94-4be2-91e4-48a43d3924ee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.159701 Aug 31 19:29:39.485381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 294/574] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:39 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:39.792693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-905279a7-2c97-4373-bf00-7f37d6b2a0d2 req-c4cf8081-0fde-4c13-9fdc-dacfa8560478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "name": "network-vif-plugged", "status": "completed", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:39.803582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-905279a7-2c97-4373-bf00-7f37d6b2a0d2 req-c4cf8081-0fde-4c13-9fdc-dacfa8560478 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.804059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-905279a7-2c97-4373-bf00-7f37d6b2a0d2 req-c4cf8081-0fde-4c13-9fdc-dacfa8560478 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.804489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-905279a7-2c97-4373-bf00-7f37d6b2a0d2 req-c4cf8081-0fde-4c13-9fdc-dacfa8560478 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:39.816423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-905279a7-2c97-4373-bf00-7f37d6b2a0d2 req-c4cf8081-0fde-4c13-9fdc-dacfa8560478 service nova] Creating event network-vif-plugged:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:29:39.821405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-905279a7-2c97-4373-bf00-7f37d6b2a0d2 req-c4cf8081-0fde-4c13-9fdc-dacfa8560478 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Aug 31 19:29:39.821980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 281/575] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:39.869013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:39.871596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:39.876767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.877268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.877709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:39.878421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:39.878902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:39.879840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:40.014572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:40.023057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:40.024506 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:40.025666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b793c1a2-d957-49e1-a044-e425a449eb1f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.160638 Aug 31 19:29:40.026418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 295/576] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:39 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:40.506478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:40.507203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:40.513456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:40.513946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:40.514393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:40.515135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:40.515601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:40.516038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:40.646753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:40.655027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e20976ed-9c5a-4e47-9fdd-2b412c5bf0fb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.152934 Aug 31 19:29:40.655589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 282/577] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:40 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:41.050004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:41.050612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:41.053175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:41.058151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:41.059050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:41.059176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:41.059820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:41.060290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:41.060799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:41.199697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:41.208744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:41.212490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:41.212490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9c31d393-d2b3-4ae4-907b-1e0c7ce8f503 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.166250 Aug 31 19:29:41.212490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 296/578] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:41 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:41.676746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:41.677287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:41.684825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:41.685310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:41.685750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:41.686447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:41.686927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:41.687361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:41.824527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:41.832958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cc582e23-badd-40c0-aab8-dd0bacbb381a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.160167 Aug 31 19:29:41.833523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 283/579] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:41 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:42.238411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:42.239270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:42.246373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:42.246857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:42.247317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:42.248074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:42.248633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:42.249144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:42.389789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:42.401814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:42.403405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:42.404659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fb5e18df-efb3-48f9-ac04-060c91bb8942 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.172950 Aug 31 19:29:42.405497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 297/580] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:42 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:42.853503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:42.854114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:42.856527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=55 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:42.861793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:42.862285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:42.862731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:42.863529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:42.864006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:42.864482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:42.994904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:43.003106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a0342893-47dc-4e68-b700-f0be6a5aa3f6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.153448 Aug 31 19:29:43.003690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 284/581] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:42 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:43.429004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:43.429774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:43.436353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:43.437199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:43.437323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:43.437961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:43.438422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:43.438852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:43.591676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:43.601853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:43.603522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:43.604986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ce022d34-caa9-4f45-acae-72219637a12e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1747 microversion: 2.20 time: 0.179874 Aug 31 19:29:43.605622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 298/582] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:43 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1747 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:44.024563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:44.025217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:44.031744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:44.032630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:44.032728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:44.033357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:44.033849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:44.034279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:44.173845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:44.184364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-abb735b8-7473-4270-9f97-59359f7b00d0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.163735 Aug 31 19:29:44.185855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 285/583] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:44 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:44.629367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:44.630799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:44.649916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:44.649916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:44.649916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:44.649916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:44.650309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:44.650309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:44.848618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:44.849300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:44.855847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:44.856650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:44.857328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:44.858266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:44.859007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:44.859451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:44.866094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:44.876600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:44.879471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:44.880775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1ff84a28-92c8-46ef-be07-727edd3d4beb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.256440 Aug 31 19:29:44.890896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 299/584] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:44 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:45.005742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:45.014569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-97ea6afe-050e-43fd-b094-b3e2f11766d8 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1593 microversion: 2.1 time: 0.170819 Aug 31 19:29:45.015169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 286/585] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:44 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1593 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:45.209624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:45.210411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:45.228662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:45.229163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:45.229605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:45.230317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:45.230904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:45.231215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:45.399823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:45.416060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-df272991-3057-4d51-90ce-33e212d36ad3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.212787 Aug 31 19:29:45.424249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 300/586] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:45 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:45.907837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:45.914745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:45.926282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:45.927242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:45.927878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:45.928702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:45.929240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:45.929900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:46.105206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:46.114296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:46.115750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:46.117160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-212f6772-ba8a-4f2f-ae9b-bd26b739f2fc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.215331 Aug 31 19:29:46.118294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 287/587] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:45 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:46.439431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:46.440309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:46.447720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:46.448577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:46.449468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:46.450580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:46.451283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:46.451919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:46.689590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:46.703916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9105d861-869e-479c-b4a3-ee6a52e7c216 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.268614 Aug 31 19:29:46.704507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 301/588] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:46 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:47.147069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:47.147650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:47.157414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:47.160999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:47.160999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:47.160999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:47.160999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:47.161360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:47.318377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:47.326627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:47.328114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:47.329266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-64210a43-432e-433d-904a-a8bea3272d33 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.191482 Aug 31 19:29:47.329820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 288/589] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:47 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:47.728348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:47.729871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:47.740842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:47.743341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:47.743341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:47.743341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:47.743915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:47.744575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:47.752636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-610d6c03-98a6-41ad-b3db-dcc9a8718f0a req-4e454e53-d600-43c3-a553-1a707bbe7d8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:47.762669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-610d6c03-98a6-41ad-b3db-dcc9a8718f0a req-4e454e53-d600-43c3-a553-1a707bbe7d8a service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:47.763198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-610d6c03-98a6-41ad-b3db-dcc9a8718f0a req-4e454e53-d600-43c3-a553-1a707bbe7d8a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:47.763635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-610d6c03-98a6-41ad-b3db-dcc9a8718f0a req-4e454e53-d600-43c3-a553-1a707bbe7d8a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:47.777140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-610d6c03-98a6-41ad-b3db-dcc9a8718f0a req-4e454e53-d600-43c3-a553-1a707bbe7d8a service nova] Creating event network-changed:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:29:47.785254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-610d6c03-98a6-41ad-b3db-dcc9a8718f0a req-4e454e53-d600-43c3-a553-1a707bbe7d8a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036216 Aug 31 19:29:47.786508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 289/590] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:29:48.035875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:48.046067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ba09d92f-758b-4bb7-a811-55fcf9814945 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1722 microversion: 2.1 time: 0.322787 Aug 31 19:29:48.047593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 302/591] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:47 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:48.361599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:48.363265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:48.382884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:48.391762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:48.392512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:48.395812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:48.399287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:48.399899 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:48.629137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:48.641264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:48.643780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:48.645452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9b4a1c2c-2135-457e-b6f8-3f22238d707a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.290051 Aug 31 19:29:48.665310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 290/592] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:48 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:49.072283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:49.073526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:49.083187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.083187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.083938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.084984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.085447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.085876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.254947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:49.264245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-23cb04e6-a5f2-4ec4-a58d-fdcf002e00ca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1699 microversion: 2.1 time: 0.195936 Aug 31 19:29:49.264863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 303/593] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:49 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1699 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:49.287164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c1637274-1a72-4bce-b2e8-9cf3c461d2b0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:49.293980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c1637274-1a72-4bce-b2e8-9cf3c461d2b0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.294698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c1637274-1a72-4bce-b2e8-9cf3c461d2b0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.295284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c1637274-1a72-4bce-b2e8-9cf3c461d2b0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.382065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:49.386477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c1637274-1a72-4bce-b2e8-9cf3c461d2b0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Going to try to start instance {{(pid=121186) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 19:29:49.556692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c1637274-1a72-4bce-b2e8-9cf3c461d2b0 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action" status: 202 len: 0 microversion: 2.1 time: 0.274570 Aug 31 19:29:49.559935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 291/594] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:29:49 2022] POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:29:49.574000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:49.574933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:49.587487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.588172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.588929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.590384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.591133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.591743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.672868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:49.673843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:49.683200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.684215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.685505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.686401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:49.687116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:49.688191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:49.819004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:49.835759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a9417c0d-49f1-4f39-b98f-42d938783c12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1708 microversion: 2.1 time: 0.271847 Aug 31 19:29:49.859362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 304/595] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:49 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1708 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:49.887814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:49.897799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:49.899358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:49.900587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4cde47a1-5036-4120-97b9-8414cbd20f0b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.234700 Aug 31 19:29:49.901150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 292/596] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:49 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:50.797914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1366432416"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:50.798518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:50.808525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:50.813263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:50.813263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:50.813263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:50.813263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:50.813623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:50.857440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:50.858059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:50.871998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:50.871998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:50.871998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:50.871998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:50.872469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:50.872469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:50.993133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.network.security_group_api [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Adding security group 743b471f-f46f-41fa-bd37-f686ac9b9cce to port 86560688-f0cc-412f-aa9d-12bebb775652 Aug 31 19:29:51.065992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:51.076984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e9f2872d-6b98-44cc-9097-ddfcb25bd328 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1708 microversion: 2.1 time: 0.223351 Aug 31 19:29:51.078013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 293/597] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:50 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1708 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:51.090988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:51.091601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:51.098037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:51.098520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:51.098981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:51.099687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:51.100140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:51.100557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:51.242948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:51.251376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:51.252911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:51.254087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-97eed05b-5225-467c-91ed-606702d7e3a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.172936 Aug 31 19:29:51.254674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 294/598] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:51 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:51.558240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0cc3f087-a2a8-4819-b2ee-3ee41e8b1696 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/action" status: 202 len: 0 microversion: 2.1 time: 0.764255 Aug 31 19:29:51.562582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 305/599] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:29:50 2022] POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:29:51.567675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:51.568216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:51.568855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-f9e3bdd0-57ee-4d48-9008-04ee05469e8d req-41a6fbd2-5b8d-4f57-ae4d-7c4212c556ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:29:51.578162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:51.578587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:51.579062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:51.579291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-f9e3bdd0-57ee-4d48-9008-04ee05469e8d req-41a6fbd2-5b8d-4f57-ae4d-7c4212c556ae service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:51.579770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:51.579879 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-f9e3bdd0-57ee-4d48-9008-04ee05469e8d req-41a6fbd2-5b8d-4f57-ae4d-7c4212c556ae service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:51.580694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-f9e3bdd0-57ee-4d48-9008-04ee05469e8d req-41a6fbd2-5b8d-4f57-ae4d-7c4212c556ae service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:51.581072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:51.581383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:51.594896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-f9e3bdd0-57ee-4d48-9008-04ee05469e8d req-41a6fbd2-5b8d-4f57-ae4d-7c4212c556ae service nova] Creating event network-changed:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:29:51.602907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-f9e3bdd0-57ee-4d48-9008-04ee05469e8d req-41a6fbd2-5b8d-4f57-ae4d-7c4212c556ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037729 Aug 31 19:29:51.605313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 306/600] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:29:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:29:51.772329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:51.783140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-22ee771c-0930-4c88-8cb6-fa09a71ae015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1759 microversion: 2.1 time: 0.219195 Aug 31 19:29:51.784991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 295/601] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:51 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1759 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:52.099449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:52.100158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:52.109435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:52.109861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:52.110359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:52.111099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:52.111872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:52.112523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:52.117381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:52.278589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:52.279061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:52.293163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:52.296380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:52.296380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:52.296380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:52.296380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:52.296787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:52.296867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:52.310611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75762ae2-862b-421b-a9fa-bd68472d30d7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1708 microversion: 2.1 time: 0.216546 Aug 31 19:29:52.318084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 307/602] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:52 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1708 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:52.482541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:52.494286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:52.496425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:52.497884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4b98ee8a-8bce-4021-b127-ded8ffa07767 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.224393 Aug 31 19:29:52.511678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 296/603] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:52 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:53.337130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:53.338350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:53.345264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:53.346426 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:53.346955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:53.347737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:53.348274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:53.348917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:53.524427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:53.525725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:53.532021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:53.532732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:53.533649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:53.534504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:53.535104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:53.535746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:53.537012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:53.546025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dea9221d-083a-45c3-80d3-ec6e9c4adc95 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1712 microversion: 2.1 time: 0.212658 Aug 31 19:29:53.559549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 308/604] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:29:53 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1712 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:29:53.692430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:53.701173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:53.703798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:53.705964 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f55a0fb5-1603-45a7-8fa9-d3a86a71d92c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.184797 Aug 31 19:29:53.706686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 297/605] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:53 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:54.730498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:54.735891 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:54.738988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:54.739631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:54.740077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:54.740801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:54.741490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:54.741938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:54.889631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:54.900459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:54.901913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:54.903136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0eb7e3ac-9c9d-41d4-aa43-fc4ad6fff8e1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.177092 Aug 31 19:29:54.903693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 309/606] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:54 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:55.926977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:55.928880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:55.936248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:55.936849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:55.937295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:55.938061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:55.938516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:55.938986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:56.211315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:56.222032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:56.223686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:56.225038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c8c7dedc-ecd9-4a81-a55c-0a77cf6ce941 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.303248 Aug 31 19:29:56.226023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 298/607] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:55 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:57.252801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:57.253419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:57.259849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:57.260334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:57.260774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:57.261463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:57.261930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:57.262358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:57.445108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:57.453055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:57.454487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:57.455964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7d204c69-96bc-489f-a395-a3cb1a043f46 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1742 microversion: 2.20 time: 0.207655 Aug 31 19:29:57.456520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 310/608] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:57 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:29:58.479782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:58.480427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:58.486939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:58.487435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:58.487884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:58.488594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:58.489052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:58.489480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:58.620668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:58.629388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:58.630999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:58.632171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-76ec763e-0a70-4044-8f93-9f2284963469 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1724 microversion: 2.20 time: 0.156303 Aug 31 19:29:58.632743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 299/609] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:58 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:29:59.656394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:29:59.657023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:29:59.660417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=56 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:29:59.665156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:59.665648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:59.666096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:59.666798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:29:59.667290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:29:59.667730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:29:59.798264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:59.806597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:59.808074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:29:59.809230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0efd3bee-896f-490a-a7f1-9b7bd4be8324 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1724 microversion: 2.20 time: 0.156816 Aug 31 19:29:59.809783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 311/610] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:29:59 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:00.832029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:00.832610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:00.841985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:00.842484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:00.842968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:00.843683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:00.844480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:00.844934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:00.983796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:00.996546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:00.996546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:00.996546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1d04c8da-3516-45ef-91d8-93ad3c16c85a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1724 microversion: 2.20 time: 0.168174 Aug 31 19:30:00.996893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 300/611] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:00 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:01.935898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-dc891083-47c4-4bfc-8b2c-677289d997af req-95303aa2-fb76-426e-8738-b0cba9b8a7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "name": "network-vif-unplugged", "status": "completed", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:01.946302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-dc891083-47c4-4bfc-8b2c-677289d997af req-95303aa2-fb76-426e-8738-b0cba9b8a7e3 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:01.953266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-dc891083-47c4-4bfc-8b2c-677289d997af req-95303aa2-fb76-426e-8738-b0cba9b8a7e3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:01.953266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-dc891083-47c4-4bfc-8b2c-677289d997af req-95303aa2-fb76-426e-8738-b0cba9b8a7e3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:01.959302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-dc891083-47c4-4bfc-8b2c-677289d997af req-95303aa2-fb76-426e-8738-b0cba9b8a7e3 service nova] Creating event network-vif-unplugged:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:30:01.964463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-dc891083-47c4-4bfc-8b2c-677289d997af req-95303aa2-fb76-426e-8738-b0cba9b8a7e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035878 Aug 31 19:30:01.965068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 312/612] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:30:02.019426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:02.020548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:02.027454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:02.028017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:02.028463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:02.029175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:02.029637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:02.030114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:02.165646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:02.174012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:02.175516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:02.176714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-136e551e-4a20-4766-a51b-e8379b6508b8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1667 microversion: 2.20 time: 0.162026 Aug 31 19:30:02.177296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 301/613] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:02 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1667 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:02.204286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fa76219-99e1-4908-aa94-acdf03074ca0"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:02.207329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:02.213484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:02.213962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:02.214393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:02.215117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:02.215573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:02.215994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:03.243525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bb96d43d-5507-492a-b1cb-9806adfaba40 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.043342 Aug 31 19:30:03.244171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 313/614] 10.222.0.59 () {62 vars in 1364 bytes} [Wed Aug 31 19:30:02 2022] POST /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments => generated 188 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 19:30:03.368681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:03.369276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:03.375667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:03.376148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:03.376584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:03.377272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:03.377728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:03.378642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:03.421229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121186) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:30:03.758102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5b565341-faba-4dbe-b4c4-fc01d845085d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/action" status: 202 len: 0 microversion: 2.20 time: 0.393196 Aug 31 19:30:03.758715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 302/615] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 31 19:30:03 2022] POST /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:30:03.766889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:03.768337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:03.774333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:03.774825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:03.775298 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:03.776003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:03.776463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:03.776899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:03.909929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:03.919293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:03.920749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:03.922038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7e1e5f3e-209e-4295-8e0c-85272552dea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1753 microversion: 2.20 time: 0.159041 Aug 31 19:30:03.922621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 314/616] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:03 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:04.946468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:04.947108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:04.953217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:04.953713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:04.954159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:04.954908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:04.955371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:04.955807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:05.090299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:05.100095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:05.101538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:05.102705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ef8273c1-91be-4fef-bded-30b829b41cf8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1753 microversion: 2.20 time: 0.160883 Aug 31 19:30:05.103486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 303/617] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:04 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:06.125438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:06.125952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:06.132311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:06.133561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:06.133561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:06.133886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:06.134339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:06.134760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:06.268162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:06.296998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:06.296998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:06.296998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7543983d-5b8d-4ed5-aba1-f07c1ac9d380 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1755 microversion: 2.20 time: 0.158355 Aug 31 19:30:06.297327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 315/618] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:06 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:07.302735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:07.303422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:07.310111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:07.310556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:07.311060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:07.311759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:07.312219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:07.312764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:07.444702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:07.453425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:07.454884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:07.456058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-18652370-9f08-4b03-beba-8837e4d884a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1755 microversion: 2.20 time: 0.157522 Aug 31 19:30:07.456674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 304/619] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:07 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:08.480113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:08.480720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:08.487203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:08.487685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:08.488120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:08.488814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:08.489270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:08.489697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:08.688473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:08.697742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:08.699229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:08.700396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a2514171-c78d-455d-940b-3b9f71dc0f18 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.224207 Aug 31 19:30:08.700967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 316/620] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:08 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:09.725839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:09.727586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:09.734811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:09.735429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:09.735938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:09.736713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:09.737275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:09.737768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:09.883904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:09.892340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:09.893787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:09.895068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b1238383-7e84-4110-abd9-48f86db6d100 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.174996 Aug 31 19:30:09.895632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 305/621] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:09 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:10.918769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:10.919636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:10.932786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:10.933274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:10.933917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:10.934622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:10.935281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:10.935766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:11.077507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:11.088083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:11.089539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:11.090855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5ff139c2-59f0-4deb-aa88-418f6bd30ae6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.175933 Aug 31 19:30:11.091649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 317/622] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:10 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:12.243764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:12.244385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:12.251656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:12.252148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:12.252594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:12.253311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:12.253768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:12.254198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:12.259046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:12.406692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:12.418927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:12.418927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:12.419444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2e3bdc3b-5cca-4349-856b-43504d1c341f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.309535 Aug 31 19:30:12.420200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 306/623] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:12 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:13.442611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:13.443274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:13.450728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:13.451271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:13.451710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:13.452435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:13.452893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:13.453324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:13.589700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:13.599024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:13.600405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:13.601574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-96c6d1c2-7c83-461e-aaee-c70277981e00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.162807 Aug 31 19:30:13.602424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 318/624] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:13 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:14.626363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:14.627028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:14.629662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:14.634571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:14.635105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:14.635557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:14.636292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:14.636736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:14.637201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:14.783858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:14.793258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:14.794709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:14.795967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f398f57a-95bc-44f5-9b7b-4fd468746abf tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.174251 Aug 31 19:30:14.796733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 307/625] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:14 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:15.819833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:15.821042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:15.828306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:15.828734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:15.829175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:15.829884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:15.830342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:15.830781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:15.994702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:16.004928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:16.049958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:16.049958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-94362a1c-6251-4440-b845-1501f724fb78 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.191676 Aug 31 19:30:16.049958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 319/626] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:15 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:17.044815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:17.045460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:17.052248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:17.052902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:17.053298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:17.054010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:17.054471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:17.055469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:17.207621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:17.217884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:17.220859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:17.220859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7dc6d126-49cb-4570-a473-ed7bc87c00d6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.180237 Aug 31 19:30:17.222790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 308/627] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:17 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:18.245624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:18.246218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:18.253230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:18.253749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:18.254190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:18.254908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:18.255584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:18.256015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:18.402132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:18.411213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:18.412654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:18.413767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e141d8f6-4be8-4486-8ef0-e8b23d5cc6aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.172757 Aug 31 19:30:18.415107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 320/628] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:18 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:19.437626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:19.438992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:19.446582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:19.447102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:19.447542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:19.448245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:19.448700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:19.449124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:19.596953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:19.606668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:19.608125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:19.609318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-394d6fd4-f087-43d7-a8ac-2d7070751611 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.175618 Aug 31 19:30:19.609871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 309/629] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:19 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:20.633758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:20.634355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:20.641619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:20.642123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:20.642571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:20.643348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:20.643814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:20.644250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:20.807109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:20.810842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:20.817577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:20.819076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:20.823060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-36c649e5-9bdc-4d31-a303-f177dc98a2d3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.190695 Aug 31 19:30:20.823060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 321/630] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:20 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:21.845542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:21.846593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:21.854241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:21.854812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:21.855316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:21.856028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:21.856492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:21.856956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:21.992702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:22.002345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:22.003837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:22.005002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7b8b8466-fe2a-4ca7-9375-2c5b9497cb09 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.164521 Aug 31 19:30:22.005568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 310/631] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:21 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:23.029699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:23.030296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:23.037063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:23.037543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:23.037978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:23.038663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:23.039272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:23.039694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:23.173902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:23.182818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:23.184264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:23.185408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6d112d5b-b059-493b-a5f1-525d08722c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.160091 Aug 31 19:30:23.185981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 322/632] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:23 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:24.208770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:24.209399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:24.216995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:24.217574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:24.218062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:24.219130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:24.219596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:24.220029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:24.373623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:24.383871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:24.385487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:24.386663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4620db04-d2ee-46cf-824f-9b572bd4185c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.181995 Aug 31 19:30:24.387262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 311/633] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:24 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:24.532594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51957485-554f-43da-bc4d-7071257baf2a"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:24.535083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:24.541765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:24.542283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:24.542729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:24.543571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:24.544067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:24.544534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:25.409878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:25.410484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:25.417739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:25.418234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:25.418674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:25.419423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:25.419877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:25.420307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:25.559093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:25.568334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:25.569788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:25.571716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5bab14be-368a-43fa-9302-fbb5f818afb9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.165732 Aug 31 19:30:25.572283 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 312/634] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:25 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:26.596810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:26.597477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:26.604277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:26.604762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:26.605205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:26.605904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:26.606367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:26.606799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:26.735913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:26.745255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:26.746684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:26.747869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-348f2e45-0812-4eac-a7cd-a42bc1d7af64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.155226 Aug 31 19:30:26.748421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 313/635] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:26 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:27.771233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:27.771893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:27.779261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:27.779751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:27.780193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:27.780897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:27.781358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:27.781790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:27.911841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:27.920910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:27.922351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:27.923553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-54fa8010-097d-4309-a0cb-3a3d02c8a12d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.156542 Aug 31 19:30:27.924108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 314/636] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:27 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:28.946811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:28.947696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:28.954215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:28.954924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:28.955301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:28.956006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:28.956459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:28.956882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:29.306052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:29.314718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:29.316216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:29.317414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7b75f0d0-7617-4b4b-a6fe-de66116f994f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.374624 Aug 31 19:30:29.317975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 315/637] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:28 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:29.581701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2054bd3d-37fd-4031-99f1-d4401de6439f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.173563 Aug 31 19:30:29.582355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 323/638] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:30:24 2022] POST /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 194 bytes in 5176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:30:30.341604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:30.342234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:30.348959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:30.349442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:30.349957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:30.350634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:30.351207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:30.351639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:30.482906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:30.491984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:30.493485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:30.494642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-43322bdb-0cdf-4408-9eab-312182363d2c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.156986 Aug 31 19:30:30.495228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 316/639] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:30 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:31.518576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:31.519333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:31.521253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=26 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:31.532738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:31.532738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:31.532738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:31.532738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:31.533212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:31.533212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:31.661841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:31.671501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:31.672934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:31.674100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fd1094d6-8fec-4811-8df7-fd26da762896 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.160500 Aug 31 19:30:31.674944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 324/640] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:31 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:32.697666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:32.698404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:32.705020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:32.705507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:32.705953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:32.706667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:32.707285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:32.707724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:32.849622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:32.858989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:32.862728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:32.862728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1df1f987-0715-42ab-802c-da3a56442ef7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.168730 Aug 31 19:30:32.862728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 317/641] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:32 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:33.884850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:33.885522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:33.892004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:33.892465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:33.892900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:33.893596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:33.894046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:33.894465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:34.023030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:34.032477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:34.033920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:34.035130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-05a042d9-4bdf-49ad-a4bd-5ef5dad4d3aa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.154634 Aug 31 19:30:34.035703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 325/642] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:33 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:35.057054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:35.057657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:35.064528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:35.065012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:35.065450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:35.066149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:35.066602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:35.067065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:35.201994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:35.210805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:35.213142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:35.214304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b64a94dd-0d74-44cf-b7c1-1201d41973c3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.161249 Aug 31 19:30:35.214944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 318/643] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:35 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:36.237568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:36.238104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:36.244596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:36.245085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:36.245545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:36.246255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:36.246786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:36.247237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:36.378816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:36.388574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:36.390008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:36.391209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67965f14-00b3-494b-b257-7d6b7598fc47 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.157545 Aug 31 19:30:36.391768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 326/644] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:36 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:37.415185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:37.415790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:37.422308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:37.422858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:37.423442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:37.424146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:37.424609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:37.425047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:37.565506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:37.575313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:37.576816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:37.578026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0122fdeb-c31c-4b88-8875-b9b218993a85 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.167755 Aug 31 19:30:37.578590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 319/645] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:37 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:38.183944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:38.186223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:38.192887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:38.193376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:38.193815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:38.194543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:38.195053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:38.196004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:38.220290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'flavor' on Instance uuid ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:30:38.525226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c5bef68c-2698-4723-a7a2-b24cd5b3996e tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/action" status: 200 len: 32 microversion: 2.1 time: 0.345422 Aug 31 19:30:38.525843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 327/646] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:30:38 2022] POST /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/action => generated 32 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:30:38.536247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:38.536788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:38.543614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:38.552387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:38.552387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:38.552387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:38.552387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:38.552847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:38.602325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:38.603539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:38.610540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:38.611671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:38.612114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:38.612833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:38.613378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:38.613802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:38.682782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:38.692258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a08fc4af-cb7e-49a2-ba49-1faedd802707 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.160694 Aug 31 19:30:38.692860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 320/647] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:38 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:38.793553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:38.802499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:38.803977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:38.805831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f7575c14-b5a6-4e7a-8e69-8d5004dccf9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.207256 Aug 31 19:30:38.813045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 328/648] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:38 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:39.714243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:39.714895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:39.721702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:39.722191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:39.722639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:39.723375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:39.723835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:39.724276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:39.833744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:39.834359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:39.841794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:39.842288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:39.843028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:39.843742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:39.844202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:39.844814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:39.861105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:39.869927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-662c823c-bb50-46cd-9c0b-df136c199888 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.160187 Aug 31 19:30:39.870578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 321/649] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:39 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:39.980569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:39.989015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:39.990436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:39.991604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5a1bf425-d964-456f-a43f-11e726c79979 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.161906 Aug 31 19:30:39.992158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 329/650] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:39 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:40.580174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-cba2b8cb-5be8-413d-b47d-605e6d1b0f40 req-2ae736d8-a71b-464a-8950-b2fac174942e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "name": "network-vif-plugged", "status": "completed", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:40.589955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-cba2b8cb-5be8-413d-b47d-605e6d1b0f40 req-2ae736d8-a71b-464a-8950-b2fac174942e service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:40.590435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-cba2b8cb-5be8-413d-b47d-605e6d1b0f40 req-2ae736d8-a71b-464a-8950-b2fac174942e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:40.590881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-cba2b8cb-5be8-413d-b47d-605e6d1b0f40 req-2ae736d8-a71b-464a-8950-b2fac174942e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:40.602604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-cba2b8cb-5be8-413d-b47d-605e6d1b0f40 req-2ae736d8-a71b-464a-8950-b2fac174942e service nova] Creating event network-vif-plugged:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:30:40.607735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-cba2b8cb-5be8-413d-b47d-605e6d1b0f40 req-2ae736d8-a71b-464a-8950-b2fac174942e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Aug 31 19:30:40.608311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 322/651] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:30:40.892045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:40.892655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:40.899874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:40.900423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:40.900867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:40.901563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:40.902023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:40.902452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:41.015339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:41.016124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:41.022444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:41.023183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:41.024156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:41.025117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:41.025590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:41.026025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:41.032743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:41.042042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ea12486a-6bed-46bd-82f0-8269804f8d3c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.153796 Aug 31 19:30:41.042607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 330/652] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:40 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:41.046022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:41.170491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:41.179429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:41.181617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:41.183146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2a64ad5a-c630-488e-9035-ab779eb8515e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.173005 Aug 31 19:30:41.191058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 323/653] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:41 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:42.063783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:42.064391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:42.071621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:42.072107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:42.072545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:42.073240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:42.073697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:42.074127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:42.205849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:42.207340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:42.208069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:42.215152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:42.215374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0cbf21be-3591-46b2-b239-50f422a21610 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.155387 Aug 31 19:30:42.216097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 331/654] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:42 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:42.216254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:42.216411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:42.217308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:42.218021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:42.218453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:42.350174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:42.359617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:42.361059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:42.362219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8e467611-f31a-4a36-a603-475606107222 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.160369 Aug 31 19:30:42.362782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 324/655] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:42 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:43.237249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:43.237865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:43.245152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:43.245646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:43.246089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:43.246792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:43.247363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:43.247799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:43.376083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:43.385186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a1a49e23-dea3-4b47-ab20-e9fb4dfbcec4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.151843 Aug 31 19:30:43.385761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 332/656] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:43 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:43.386651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:43.387303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:43.393732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:43.394222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:43.394666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:43.395402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:43.395863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:43.396302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:43.529918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:43.538625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:43.540781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:43.541945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e90b98e7-1a58-4f5d-8714-cdbf83cb7088 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.160184 Aug 31 19:30:43.542527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 325/657] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:43 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:44.407166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:44.407805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:44.415921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:44.416413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:44.416946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:44.417674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:44.418244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:44.418706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:44.559047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:44.565193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:44.565830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:44.568501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5b1e89d7-1bc2-42bc-ab66-43fedf354ffb tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.165373 Aug 31 19:30:44.569577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 333/658] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:44 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:44.573586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:44.574082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:44.574557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:44.575313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:44.575778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:44.576210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:44.712973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:44.721878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:44.723355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:44.724561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c06c4d93-e2e8-4cd8-b1e0-61759fb25af9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1811 microversion: 2.20 time: 0.163440 Aug 31 19:30:44.725125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 326/659] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:44 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:30:45.592758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:45.593375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:45.599790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:45.600280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:45.600722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:45.602162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:45.602749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:45.603225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:45.732834 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:45.741977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-564c9401-f603-463e-8ee7-0afee6d6f11d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.153453 Aug 31 19:30:45.742957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 334/660] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:45 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:45.752727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:45.753462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:45.755963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=40 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:45.761577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:45.763688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:45.763688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:45.763688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:45.764010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:45.764157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:45.901962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:45.910969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:45.912475 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:45.918178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d1f92e01-884e-42de-a61e-8e05e6cd7efa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1798 microversion: 2.20 time: 0.164880 Aug 31 19:30:45.918178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 327/661] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:30:45 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1798 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:30:46.763801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:46.764457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:46.771228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:46.771770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:46.772193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:46.772932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:46.773392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:46.773857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:46.778602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:30:46.909044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:46.917925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-11426734-fe62-4ada-8aca-b373a9f2143a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.157968 Aug 31 19:30:46.918489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 335/662] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:46 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:30:47.940179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:47.940802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:47.947559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:47.948029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:47.949034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:47.949755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:47.949755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:47.952897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:48.098962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:48.108041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ec39c476-ba59-4efb-838a-6f64a013dfd4 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.172444 Aug 31 19:30:48.108614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 328/663] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:47 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:49.131819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:49.132408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:49.139628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:49.140108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:49.140549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:49.141243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:49.141804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:49.142416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:49.291768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:49.300437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-24430d87-0999-4a6b-be31-054dee265418 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.172487 Aug 31 19:30:49.301037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 336/664] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:49 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:50.322379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:50.323160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:50.329762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:50.330328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:50.330777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:50.331548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:50.331999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:50.332429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:50.468827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:50.476527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-db231422-a982-4a7e-82c9-056974c52ba3 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.158614 Aug 31 19:30:50.477439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 329/665] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:50 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:51.497723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:51.498331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:51.504931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:51.505424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:51.505859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:51.506561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:51.507049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:51.507472 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:51.648415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:51.657423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e0470205-1af4-4063-8340-1eac237c3b33 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.163524 Aug 31 19:30:51.657993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 337/666] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:51 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:52.680603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:52.681519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:52.688714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:52.689315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:52.689625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:52.690326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:52.690962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:52.691394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:52.856897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:52.865121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-84962ef3-fe98-475a-bdfb-e0bdeb4e2e8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.188676 Aug 31 19:30:52.865708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 330/667] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:52 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:30:53.898706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:53.899519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:53.910252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:53.910946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:53.911541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:53.912624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:53.913460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:53.914087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:54.052346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:54.063396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9f733155-9036-4b9e-acc1-9f12aa82df56 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.170745 Aug 31 19:30:54.064234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 338/668] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:53 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:55.089462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:55.090403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:55.100696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:55.101254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:55.101756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:55.102610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:55.103321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:55.104064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:55.255060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:55.268062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8886734e-e569-47a2-b568-e31b98ca1860 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1737 microversion: 2.1 time: 0.185989 Aug 31 19:30:55.268846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 331/669] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:55 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:56.289927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:56.290887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:56.297532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.298040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.298483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.299207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.299670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.300105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.439481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:56.448132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-07ed03ad-3836-440b-91e5-c6bf5f67b01c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1717 microversion: 2.1 time: 0.162353 Aug 31 19:30:56.448781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 339/670] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:56 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:56.513816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:56.514926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:56.522987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.523480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.524556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.525764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.526167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.526605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.663608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] HTTP exception thrown: Cannot 'detach_volume' instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 while it is in vm_state rescued Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Request method failure captured: Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments/51957485-554f-43da-bc4d-7071257baf2a HTTP/1.1 Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WTSwqL5fj_-7PvAGhkDP9X0avlP3tH5hgP1Gd7O66yBB0wkk28pRE7tPInpIGra5uwRIYynaiwhRzzvGg9kgRO_iP-S64n-M6Y20jU6uRFHwHZhgawtbK79TbYB6b1a8klLWfVdEeRDE034IIO7toQYxzqsca7JCLsjcVn3uz_AMs Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:30:56.665299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a7e6027f7c1241dcb09786ff94df5c2f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: d441bbdb43c5403abf8480146bc15753 Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:30:56.666776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Cannot 'detach_volume' instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 while it is in vm_state rescued Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'server_id': 'ebfd4317-2f4a-492d-a077-f5a77c2fc9e6', 'id': '51957485-554f-43da-bc4d-7071257baf2a'} Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:30:56.667896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 while it is in vm_state rescued Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 while it is in vm_state rescued Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:30:56.669450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Returning 409 to user: Cannot 'detach_volume' instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 while it is in vm_state rescued {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:30:56.670903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d541eef8-c5f3-4cc4-b56c-fb4a1a22c996 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments/51957485-554f-43da-bc4d-7071257baf2a" status: 409 len: 152 microversion: 2.1 time: 0.157043 Aug 31 19:30:56.670903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 332/671] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:30:56 2022] DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments/51957485-554f-43da-bc4d-7071257baf2a => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:30:56.676130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:30:56.683711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:56.683711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.684069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.684504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.685209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.685659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.686081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.923230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5115613b-591b-4947-b938-79a8978afc98 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "POST /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/action" status: 202 len: 0 microversion: 2.1 time: 0.250955 Aug 31 19:30:56.924037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 340/672] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:30:56 2022] POST /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:30:56.933098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:56.933704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:56.940790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.941282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.941715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:56.942415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:56.943009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:56.943437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:57.089591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:57.100375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-122d6937-a905-4ebb-a471-ec3651eb8574 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1725 microversion: 2.1 time: 0.172020 Aug 31 19:30:57.100981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 333/673] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:56 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:58.124018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:58.124756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:58.131360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:58.131855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:58.132296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:58.133023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:58.134047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:58.134485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:58.277395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:58.287634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d8c1be59-6e87-4891-bb39-bd34ec000835 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1725 microversion: 2.1 time: 0.168370 Aug 31 19:30:58.288230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 341/674] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:58 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:30:59.310575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:30:59.311223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:30:59.318594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:59.319113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:59.319556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:59.320293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:30:59.320756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:30:59.321184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:30:59.454343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:30:59.462435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3b989e3c-a9fb-4ad8-b820-354e5d182a8f tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1725 microversion: 2.1 time: 0.156701 Aug 31 19:30:59.463543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 334/675] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:30:59 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:00.485076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:00.485822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:00.492251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:00.492741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:00.493180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:00.494391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:00.494852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:00.495307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:00.630823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:00.639502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a31675fa-9177-4a9d-8bdb-1dd9dae7a99b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1725 microversion: 2.1 time: 0.158301 Aug 31 19:31:00.640077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 342/676] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:00 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:01.661436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:01.662047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:01.668752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:01.669239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:01.669679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:01.670389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:01.670855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:01.671315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:01.805522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:01.814939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dc685159-e1cc-4349-af2e-f9037ff36392 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1725 microversion: 2.1 time: 0.157199 Aug 31 19:31:01.815526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 335/677] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:01 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:02.839984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:02.840542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:02.843189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=38 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:02.847961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:02.848503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:02.848956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:02.849675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:02.850162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:02.851282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:02.987159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:02.995935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c414a5c4-f1c0-4a90-95ba-1e7487872e43 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1731 microversion: 2.1 time: 0.163009 Aug 31 19:31:02.996501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 343/678] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:02 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:03.017879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:03.018452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:03.024632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:03.025120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:03.026271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:03.027019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:03.027478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:03.027902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:03.121571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d9cdeac3-7e07-4a88-958c-b9e94f263479 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107663 Aug 31 19:31:03.122195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 336/679] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:31:03 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:04.219389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-50a7d32e-d0a3-4c49-9046-d8b35aabe31e req-9d89a044-186c-4ae9-aed2-e85026cb84db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfd4317-2f4a-492d-a077-f5a77c2fc9e6", "tag": "3b5690b6-4b17-4483-8488-59210ca2f88f"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:04.229370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-50a7d32e-d0a3-4c49-9046-d8b35aabe31e req-9d89a044-186c-4ae9-aed2-e85026cb84db service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:04.230088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-50a7d32e-d0a3-4c49-9046-d8b35aabe31e req-9d89a044-186c-4ae9-aed2-e85026cb84db service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:04.230522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-50a7d32e-d0a3-4c49-9046-d8b35aabe31e req-9d89a044-186c-4ae9-aed2-e85026cb84db service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:04.244328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-50a7d32e-d0a3-4c49-9046-d8b35aabe31e req-9d89a044-186c-4ae9-aed2-e85026cb84db service nova] Creating event network-changed:3b5690b6-4b17-4483-8488-59210ca2f88f for instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 on hv-cinder-85220 Aug 31 19:31:04.250324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-50a7d32e-d0a3-4c49-9046-d8b35aabe31e req-9d89a044-186c-4ae9-aed2-e85026cb84db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093394 Aug 31 19:31:04.251127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 344/680] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:06.265754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-8ae98829-c307-413f-84e1-947652e2f70d req-fb39c7c5-6dca-4d26-a8fd-114db28f05b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfd4317-2f4a-492d-a077-f5a77c2fc9e6", "tag": "3b5690b6-4b17-4483-8488-59210ca2f88f"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:06.275666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-8ae98829-c307-413f-84e1-947652e2f70d req-fb39c7c5-6dca-4d26-a8fd-114db28f05b9 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:06.276146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-8ae98829-c307-413f-84e1-947652e2f70d req-fb39c7c5-6dca-4d26-a8fd-114db28f05b9 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:06.276572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-8ae98829-c307-413f-84e1-947652e2f70d req-fb39c7c5-6dca-4d26-a8fd-114db28f05b9 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:06.287780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-8ae98829-c307-413f-84e1-947652e2f70d req-fb39c7c5-6dca-4d26-a8fd-114db28f05b9 service nova] Creating event network-changed:3b5690b6-4b17-4483-8488-59210ca2f88f for instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 on hv-cinder-85220 Aug 31 19:31:06.293443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-8ae98829-c307-413f-84e1-947652e2f70d req-fb39c7c5-6dca-4d26-a8fd-114db28f05b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031823 Aug 31 19:31:06.294038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 337/681] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:16.675765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:16.676353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:16.678733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:16.679490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:16.685205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:16.685560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:16.686000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:16.686703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:16.687190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:16.687622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:16.712123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:31:17.125906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-74c4cde0-c484-479b-aa86-62f74f04471a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 204 len: 0 microversion: 2.1 time: 0.454007 Aug 31 19:31:17.126420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 345/682] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:31:16 2022] DELETE /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:31:17.132625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=21 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:17.133496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=80 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:17.138059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:17.138758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:17.145135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:17.145625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:17.146109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:17.146819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:17.147319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:17.147840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:17.286044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:17.294072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f072314f-0f94-4270-8a3d-15deba89abcd tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1576 microversion: 2.1 time: 0.163122 Aug 31 19:31:17.294641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 338/683] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:17 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:18.316467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:18.317169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:18.323628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:18.324114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:18.324555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:18.325252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:18.326304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:18.326733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:18.467945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:18.475876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a31fb4bc-de84-42bf-9927-18a2daeeec76 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1576 microversion: 2.1 time: 0.163677 Aug 31 19:31:18.476444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 346/684] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:18 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:19.498026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:19.498638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:19.506076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:19.506468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:19.506925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:19.507624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:19.508078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:19.508499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:19.650634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:19.659948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-10ad344f-9ba9-4d3c-b29c-57960d58e694 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1576 microversion: 2.1 time: 0.166191 Aug 31 19:31:19.671612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 339/685] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:19 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:20.444449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-3c3d1d0a-9c92-4f6f-bf0f-3fdc75961560 req-8f39fa52-9391-4980-b807-bcfadc3c70f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd04ea9-23ba-4968-9801-39230f724ace", "name": "network-vif-deleted", "tag": "9656ec16-53d3-4a35-9c76-08e64beac219"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:20.454944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3c3d1d0a-9c92-4f6f-bf0f-3fdc75961560 req-8f39fa52-9391-4980-b807-bcfadc3c70f0 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:20.455454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3c3d1d0a-9c92-4f6f-bf0f-3fdc75961560 req-8f39fa52-9391-4980-b807-bcfadc3c70f0 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:20.455901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3c3d1d0a-9c92-4f6f-bf0f-3fdc75961560 req-8f39fa52-9391-4980-b807-bcfadc3c70f0 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:20.467825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-3c3d1d0a-9c92-4f6f-bf0f-3fdc75961560 req-8f39fa52-9391-4980-b807-bcfadc3c70f0 service nova] Creating event network-vif-deleted:9656ec16-53d3-4a35-9c76-08e64beac219 for instance dfd04ea9-23ba-4968-9801-39230f724ace on hv-cinder-85220 Aug 31 19:31:20.473581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-3c3d1d0a-9c92-4f6f-bf0f-3fdc75961560 req-8f39fa52-9391-4980-b807-bcfadc3c70f0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095547 Aug 31 19:31:20.474224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 347/686] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:20.682612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:20.683282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:20.693310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:20.693981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:20.694489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:20.695301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:20.695768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:20.696399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:20.763134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:20.772924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5d41d4c4-8a85-4157-9f94-d752ec2831e4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1224 microversion: 2.1 time: 0.094998 Aug 31 19:31:20.773507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 340/687] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:20 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:21.796416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:21.797127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:21.803437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:21.803947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:21.804391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:21.805115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:21.805578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:21.806013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:21.838691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:21.839213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:21.839650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:21.840099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lazy-loading 'fault' on Instance uuid dfd04ea9-23ba-4968-9801-39230f724ace {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:31:21.882713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:21.891307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6f26737d-7a58-442d-8d80-53d3e1413a62 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 200 len: 1229 microversion: 2.1 time: 0.099722 Aug 31 19:31:21.891982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 348/688] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:21 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 1229 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:22.912067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:22.912637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:22.919151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:22.919636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:22.920078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:22.920806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:22.921357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:22.921786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:22.935039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] HTTP exception thrown: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Request method failure captured: Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace HTTP/1.1 Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7YCfQ5V5_DHt2fXjpw2aefUmJUuwo2COV0-JW1B92ifUamKr3NY58yr97i-qKBGt_y2QME6B6zoqOLYfIIUSp7HJlswiKBkzOpqtuHtb4fkmsqBnO_K88xcE-vdzVfmLr4LIgl1biaqamhBIa03EMZWm5cO1PW87J0Cy1fWZGjfvbY Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:31:22.937493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8bfa72ff61547e5a3097e5b40483f8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: be55f0bb21f044b0a8346cf953b1650e Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:31:22.939162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'dfd04ea9-23ba-4968-9801-39230f724ace'} Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:31:22.940099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:31:22.941605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:31:22.942965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Returning 404 to user: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:31:22.942965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ea910e2f-a994-4547-a476-da2561087c6f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 404 len: 111 microversion: 2.1 time: 0.030769 Aug 31 19:31:22.942965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 341/689] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:22 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:31:23.043702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-680511490", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-667416223", "security_groups": [{"name": "tempest-secgroup-smoke-130140016"}], "block_device_mapping_v2": [{"uuid": "49c7c6e6-19a0-4fe8-b34b-2d193edc69eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eef987c2-b70a-4b27-b2c6-0c199324cbe1"}]}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:23.160017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] validate_networks() for [('eef987c2-b70a-4b27-b2c6-0c199324cbe1', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:31:23.595730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:31:23.596162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:31:23.596644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:31:23.597193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:31:23.597944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:31:23.608794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:23.609344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:23.609832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:23.610624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:23.611300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:23.611811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:23.631462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:31:23.637418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for user be55f0bb21f044b0a8346cf953b1650e and project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:31:23.716526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:31:23.720001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49c7c6e6-19a0-4fe8-b34b-2d193edc69eb',volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:31:23.905912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:23.906437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:23.912624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:23.913258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:23.916035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:23.916035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:23.916035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:23.916035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:23.998360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lazy-loading 'services' on Instance uuid 2cf99492-1198-453d-9f3b-f4f8bdbc225a {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:31:24.169636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-459ed804-d567-4e1a-b968-527f98444555 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.129676 Aug 31 19:31:24.170765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 349/690] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:31:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:31:24.182047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8a58c299-9bfd-4e50-bc61-102cdc09bde9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:24.182156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8a58c299-9bfd-4e50-bc61-102cdc09bde9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:24.235421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8a58c299-9bfd-4e50-bc61-102cdc09bde9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:24.242517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8a58c299-9bfd-4e50-bc61-102cdc09bde9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1093 microversion: 2.1 time: 0.065101 Aug 31 19:31:24.243109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 350/691] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:24 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:24.258392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-806b82d9-11b4-4243-97fc-427bbc0f773c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-volume_attachments/3500c7f6-713b-4545-ab91-caf55b169ded" status: 202 len: 0 microversion: 2.1 time: 0.468061 Aug 31 19:31:24.259015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 342/692] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:31:23 2022] DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-volume_attachments/3500c7f6-713b-4545-ab91-caf55b169ded => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:31:25.262915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-60a518bb-3f99-4734-85c1-2e9e85a9ccb0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:25.263646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-60a518bb-3f99-4734-85c1-2e9e85a9ccb0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:25.316917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-60a518bb-3f99-4734-85c1-2e9e85a9ccb0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:25.324632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-60a518bb-3f99-4734-85c1-2e9e85a9ccb0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1093 microversion: 2.1 time: 0.065565 Aug 31 19:31:25.335312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 351/693] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:25 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:26.349939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7c1e0b43-20d2-4dd4-a041-ec0f96ace262 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:26.350677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7c1e0b43-20d2-4dd4-a041-ec0f96ace262 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:26.413466 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7c1e0b43-20d2-4dd4-a041-ec0f96ace262 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:26.421887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7c1e0b43-20d2-4dd4-a041-ec0f96ace262 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1093 microversion: 2.1 time: 0.077849 Aug 31 19:31:26.422376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 343/694] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:26 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:26.453503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-96c69b4b-e2c6-437d-aa0f-ecc9d90314ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:26.464747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c69b4b-e2c6-437d-aa0f-ecc9d90314ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:26.464902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c69b4b-e2c6-437d-aa0f-ecc9d90314ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:26.465342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96c69b4b-e2c6-437d-aa0f-ecc9d90314ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:26.499342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96c69b4b-e2c6-437d-aa0f-ecc9d90314ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Going to try to stop instance {{(pid=121187) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 19:31:26.745173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-96c69b4b-e2c6-437d-aa0f-ecc9d90314ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action" status: 202 len: 0 microversion: 2.1 time: 0.297034 Aug 31 19:31:26.745820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 352/695] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:31:26 2022] POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:31:26.755314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:26.755937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:26.763066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:26.768115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:26.768115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:26.768115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:26.768115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:26.768527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:26.914495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:26.922420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9cd1f298-da84-43da-abb7-0b97e2e40720 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.171444 Aug 31 19:31:26.923027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 344/696] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:26 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:27.443535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7e45c019-cff9-4a57-ba4a-073e8dec03d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:27.444260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7e45c019-cff9-4a57-ba4a-073e8dec03d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:27.499697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7e45c019-cff9-4a57-ba4a-073e8dec03d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:27.506627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7e45c019-cff9-4a57-ba4a-073e8dec03d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1093 microversion: 2.1 time: 0.067357 Aug 31 19:31:27.507228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 353/697] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:27 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:27.943821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:27.944470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:27.951002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:27.952488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:27.952488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:27.952709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:27.953028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:27.953464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:28.087650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:28.097005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-496cf148-aec4-4832-9beb-89268fb1cacc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.156988 Aug 31 19:31:28.097584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 345/698] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:27 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:28.527503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:28.528193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:28.537143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:28.537636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:28.538077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:28.538837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:28.539372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:28.539804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:28.603981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:28.612107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f2cbadd1-1197-4496-b54c-384354ac971b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1143 microversion: 2.1 time: 0.088601 Aug 31 19:31:28.612677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 354/699] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:28 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:29.119393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:29.120010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:29.127501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:29.128000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:29.128444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:29.129192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:29.129774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:29.130205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:29.265704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:29.273827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3d027b88-ab9a-4395-af62-ef27bb029e42 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.158311 Aug 31 19:31:29.274406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 346/700] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:29 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:29.633011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:29.633742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:29.640918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:29.641696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:29.642086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:29.642772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:29.643285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:29.643704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:29.707315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:29.715373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9937a87f-2767-41de-86ed-0f1b30904b85 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1143 microversion: 2.1 time: 0.086069 Aug 31 19:31:29.715942 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 355/701] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:29 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:30.295950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:30.296834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:30.303227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:30.303708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:30.304144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:30.304875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:30.305328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:30.305745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:30.435942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:30.443788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a80369b6-1a64-4b75-a438-7b552452851b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.152472 Aug 31 19:31:30.444358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 347/702] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:30 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:30.736997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:30.737622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:30.744313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:30.744806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:30.746021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:30.746021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:30.746635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:30.747101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:30.811091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:30.818892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bd6f99ca-85c5-4fd7-b7c0-b2862fed1995 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1191 microversion: 2.1 time: 0.086350 Aug 31 19:31:30.819468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 356/703] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:30 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:31.465266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:31.465912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:31.473255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:31.473255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:31.473712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:31.474409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:31.474862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:31.475314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:31.607074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:31.616312 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-da76bc51-bdf8-49fd-8bc0-b6ebfb5fd72b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.154877 Aug 31 19:31:31.616971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 348/704] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:31 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:31.845947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:31.846562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:31.853575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:31.854136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:31.854673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:31.855588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:31.856167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:31.856666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:32.105026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:32.125547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5baffb98-4b43-4aa7-91dc-c44351523baa tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1276 microversion: 2.1 time: 0.272307 Aug 31 19:31:32.125547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 357/705] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:31 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1276 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:32.638255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:32.639517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:32.647474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:32.648215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:32.648660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:32.649624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:32.650084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:32.650824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:32.790736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:32.800765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-22c435f7-d20b-4a3c-a9f3-506a177e3fae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.166621 Aug 31 19:31:32.801413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 349/706] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:32 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:32.815964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-e383571c-f809-4677-95fa-5ba29dbe0ae4 req-ac476929-b396-48f5-8175-b14cccb2876a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1b1d14-7d79-404f-865d-c089acfe0f07", "tag": "e63545f3-23e2-4661-adee-df5faf473949"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:32.825901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-e383571c-f809-4677-95fa-5ba29dbe0ae4 req-ac476929-b396-48f5-8175-b14cccb2876a service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:32.826619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-e383571c-f809-4677-95fa-5ba29dbe0ae4 req-ac476929-b396-48f5-8175-b14cccb2876a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:32.827200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-e383571c-f809-4677-95fa-5ba29dbe0ae4 req-ac476929-b396-48f5-8175-b14cccb2876a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:32.843851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-e383571c-f809-4677-95fa-5ba29dbe0ae4 req-ac476929-b396-48f5-8175-b14cccb2876a service nova] Creating event network-changed:e63545f3-23e2-4661-adee-df5faf473949 for instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 on hv-cinder-85220 Aug 31 19:31:32.848906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-e383571c-f809-4677-95fa-5ba29dbe0ae4 req-ac476929-b396-48f5-8175-b14cccb2876a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038291 Aug 31 19:31:32.849532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 358/707] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:33.021115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:33.023461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:33.029443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.029947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.030476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.031214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.032304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.032741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.136199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:33.136911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:33.143761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.146138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.146138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.146138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.146425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.146616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.258580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-40a5a29a-d7f3-4323-b59a-75d070dfab6c tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/action" status: 202 len: 0 microversion: 2.1 time: 0.241435 Aug 31 19:31:33.259510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 350/708] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:31:33 2022] POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:31:33.271642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:33.272962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:33.281047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.281555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.282000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.283172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.283638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.284072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.298593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:33.306651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ec7764b4-82e5-429d-a1cb-78c2362d7fd0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.175328 Aug 31 19:31:33.307904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 359/709] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:33 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:33.442265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:33.451053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6af3b316-6be1-49c6-b334-4e0ddd2de015 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1751 microversion: 2.1 time: 0.185930 Aug 31 19:31:33.451643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 351/710] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:33 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:33.823756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:33.824380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:33.828118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:33.831767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.838936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.838936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:33.838936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:33.838936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:33.839320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.118024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:34.126082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5765ac05-4c85-4cff-b509-48e32cd7e054 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.306581 Aug 31 19:31:34.126916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 360/711] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:33 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:34.329608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:34.330229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:34.336806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.337294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.337736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.338436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.338913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.339346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.472890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:34.473495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:34.476413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:34.479893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.480382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.480820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.481524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:34.481985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:34.482412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:34.484631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8b965a0d-5c97-47ab-a8f5-5a4bed659d42 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.159536 Aug 31 19:31:34.485208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 352/712] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:34 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:34.632033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:34.641033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-448d7138-f8fe-452c-99fd-6b417dfe5370 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1751 microversion: 2.1 time: 0.172060 Aug 31 19:31:34.641602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 361/713] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:34 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:35.148243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:35.148849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:35.154915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.155401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.155946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.156722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.157177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.157602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.289847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:35.298721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a5a3f6d4-c4fa-45d6-baa0-315f923149c1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.154290 Aug 31 19:31:35.299345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 353/714] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:35 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:35.506041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:35.506621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:35.513168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.513648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.515639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.515639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.515639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.515971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.662204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:35.663739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:35.663739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:35.672362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.672554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e26c007f-2f37-4699-8427-2c58b5cc2da0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.171242 Aug 31 19:31:35.672861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.673296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.673438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 362/715] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:35 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:35.674292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:35.674752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:35.675206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:35.694493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:35.823843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:35.832386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-908043db-9d94-4774-a0bb-8ab56a47487b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.173928 Aug 31 19:31:35.832960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 354/716] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:35 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:36.320582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:36.321205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:36.327225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.327725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.328667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.329377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.329832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.330264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.348682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:36.459530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:36.467842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-63ca9770-63f5-4de6-8645-d9d1fb302e8c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1676 microversion: 2.1 time: 0.151179 Aug 31 19:31:36.468403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 363/717] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:36 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:36.693981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:36.694591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:36.696506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:36.702033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.704479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.704479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.704479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.704810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.705011 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.836344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:36.844743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-73e1b093-bff8-4d56-95f5-e73b43500bb9 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.154720 Aug 31 19:31:36.845276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 355/718] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:36 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:36.853500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:36.854109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:36.860880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.861356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.861791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:36.862485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:36.862963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:36.863386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.007744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:37.016506 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-030d3ff5-ab1f-489b-be60-80b4cce60e80 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.166256 Aug 31 19:31:37.023641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 364/719] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:36 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:37.489869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:37.490474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:37.496587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.497071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.497575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.498270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.498750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.499205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.634090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:37.642284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a1db8dab-0eee-480a-bd90-ca224ef29e92 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1653 microversion: 2.1 time: 0.156338 Aug 31 19:31:37.642853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 356/720] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:37 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1653 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:37.660064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=12 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:37.664212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ab839562-487e-4d6c-aa6b-4b069d09cdca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:37.670308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab839562-487e-4d6c-aa6b-4b069d09cdca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.670791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab839562-487e-4d6c-aa6b-4b069d09cdca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.671265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab839562-487e-4d6c-aa6b-4b069d09cdca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.694209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ab839562-487e-4d6c-aa6b-4b069d09cdca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Going to try to start instance {{(pid=121187) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 19:31:37.852540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ab839562-487e-4d6c-aa6b-4b069d09cdca tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action" status: 202 len: 0 microversion: 2.1 time: 0.193034 Aug 31 19:31:37.853064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 365/721] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:31:37 2022] POST /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:31:37.863180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:37.865555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:37.869059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:37.869787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:37.871447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.871938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.872388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.873100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.873559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.873992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.876312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.876774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.877241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:37.877929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:37.878384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:37.878812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:38.020045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:38.023939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:38.028693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a9d93800-12e0-44f2-a035-0144585755e7 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.164852 Aug 31 19:31:38.034660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 366/722] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:37 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:38.037434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2ed6afb2-ad6b-4418-89cb-845a5c861b30 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1662 microversion: 2.1 time: 0.179332 Aug 31 19:31:38.038667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 357/723] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:37 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:38.043209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:38.043853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:38.051061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:38.051562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:38.052006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:38.054135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:38.054614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:38.055088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:38.312463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:38.322621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-518e30ba-5a73-4bfd-b2b3-13b70edd479e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.283279 Aug 31 19:31:38.323219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 367/724] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:38 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:39.052005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:39.052637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:39.058668 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:39.059146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.059308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:39.059509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.059944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.060636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.061089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.061513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.066439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.067046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.067491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.068203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.068659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.069090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.200388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:39.201308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:39.209096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bf66ee81-20d1-42a6-9fea-d44ae6f9a49d tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.160913 Aug 31 19:31:39.209499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a39e5451-a3b2-492e-8062-9b73c374cc50 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1662 microversion: 2.1 time: 0.154532 Aug 31 19:31:39.210146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 358/725] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:39 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:39.210440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 368/726] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:39 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:39.343587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:39.344198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:39.350179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.350658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.351135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.351823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:39.352274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:39.352696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:39.498772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:39.507487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-45b3f296-e0b7-43cf-ac9f-349601ff1ecb tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.167970 Aug 31 19:31:39.508053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 359/727] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:39 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:40.231369 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:40.231933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:40.232291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:40.232374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:40.238541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.239067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.239628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.239780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.240122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.240481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.240617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.240937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.241259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.241372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.241719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.242356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.376658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:40.380187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:40.385085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7ea31d34-2f7a-4610-9263-66ce0cd000e6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1666 microversion: 2.1 time: 0.157825 Aug 31 19:31:40.385662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 360/728] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:40 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:40.387976 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-435ab49a-e545-4b33-81fd-0951baabcbec tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.161151 Aug 31 19:31:40.388536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 369/729] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:40 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:40.529263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:40.529797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:40.536229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.536718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.537165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.537869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:40.538338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:40.538771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:40.681448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:40.689819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f8b54e2c-c137-4fa5-b59a-ad4852f78e5b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.164567 Aug 31 19:31:40.690390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 361/730] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:40 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:41.409497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:41.410074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:41.416514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:41.417005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:41.417447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.418153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:41.418614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:41.419085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.549009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:41.556719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d99e6e4b-d7d3-46a2-84c6-1e6241d8135c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.151927 Aug 31 19:31:41.557281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 370/731] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:41 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:41.712691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:41.713276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:41.720561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:41.721040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:41.721477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.722172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:41.722631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:41.723108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:41.868633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:41.877288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9e4268e8-d389-4fc2-9cbc-b2497748dcb4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.168543 Aug 31 19:31:41.877855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 362/732] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:41 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:42.577063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:42.577677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:42.584539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.584994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.585400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.586097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.586555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.587010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.720964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:42.728734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c449127e-6f85-4305-9b68-36546d5dd05c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.155538 Aug 31 19:31:42.729394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 371/733] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:42 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:42.898034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:42.898564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:42.904954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.905433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.905867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:42.907169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:42.907710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:42.908137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.050511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:43.058760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a5fe2e79-e36a-4cdc-9f25-8141492db4a4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.164736 Aug 31 19:31:43.059352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 363/734] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:42 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:43.750924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:43.751540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:43.757569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:43.758043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:43.758476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.759199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:43.759650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:43.760072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:43.895420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:43.903220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a46d2b9f-b113-4792-b9b4-8068d2754568 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.156959 Aug 31 19:31:43.903802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 372/735] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:43 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:44.080206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:44.080816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:44.087221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.087731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.088166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:44.088853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.089305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.089730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:44.240233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:44.248981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-38b03741-ce1c-4c4e-a10d-9921102d401e tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.172559 Aug 31 19:31:44.249575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 364/736] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:44 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:44.924109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:44.924727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:44.931292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.931783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.932225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:44.933000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:44.933385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:44.933918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:45.083854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:45.091906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-15392689-5f20-4b89-9a82-9aa9355eae71 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.171910 Aug 31 19:31:45.092466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 373/737] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:44 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:45.270998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:45.271511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:45.277553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:45.278032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:45.278463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:45.279196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:45.279646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:45.280067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:45.425896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:45.434203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-448b5e9d-eb4b-47e1-be31-a40631dc5cf6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.168094 Aug 31 19:31:45.434764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 365/738] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:45 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:46.113883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:46.114545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:46.121139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.123967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.123967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.123967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.123967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.124492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.262239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:46.271125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ab07cd54-1650-49d9-8126-bb9f55e8d389 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.161115 Aug 31 19:31:46.271737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 374/739] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:46 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:46.456054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:46.456577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:46.463124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.463615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.464060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.464779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:46.465267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:46.465935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:46.616370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:46.625078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eafbc496-259c-4bc1-a0e9-a9b0f0c65f2d tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.173011 Aug 31 19:31:46.625648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 366/740] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:46 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:47.145139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-55b2b2bd-d3a8-4eed-8d21-5083c4cedc64 req-ec0021d4-2579-4684-9602-052bd21c3ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1b1d14-7d79-404f-865d-c089acfe0f07", "name": "network-vif-plugged", "status": "completed", "tag": "e63545f3-23e2-4661-adee-df5faf473949"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:47.150016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:47.155289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-55b2b2bd-d3a8-4eed-8d21-5083c4cedc64 req-ec0021d4-2579-4684-9602-052bd21c3ede service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.157026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-55b2b2bd-d3a8-4eed-8d21-5083c4cedc64 req-ec0021d4-2579-4684-9602-052bd21c3ede service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.157026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-55b2b2bd-d3a8-4eed-8d21-5083c4cedc64 req-ec0021d4-2579-4684-9602-052bd21c3ede service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.168058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-55b2b2bd-d3a8-4eed-8d21-5083c4cedc64 req-ec0021d4-2579-4684-9602-052bd21c3ede service nova] Creating event network-vif-plugged:e63545f3-23e2-4661-adee-df5faf473949 for instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 on hv-cinder-85220 Aug 31 19:31:47.173000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-55b2b2bd-d3a8-4eed-8d21-5083c4cedc64 req-ec0021d4-2579-4684-9602-052bd21c3ede service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087664 Aug 31 19:31:47.173824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 375/741] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:47.291816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:47.292428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:47.294369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=61 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:47.300111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.300605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.306479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.306479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.306479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.306479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.442534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:47.450961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f5bd879e-0ef2-4d91-a8c0-2f37131d1dbb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.162918 Aug 31 19:31:47.451546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 367/742] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:47 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:47.647781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:47.648373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:47.654915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.656013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.656013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.656390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:47.657069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:47.657497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:47.809040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:47.818615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-50337b12-88cc-4415-b227-3b0047ba1fc6 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.176493 Aug 31 19:31:47.819286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 376/743] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:47 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:48.473499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:48.474140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:48.480760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.481247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.481690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.482397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.482858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.483360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.630325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:48.638382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4370a0a8-25c0-4584-ad00-e09459afe2bb tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.168920 Aug 31 19:31:48.638967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 368/744] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:48 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:48.840759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:48.841363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:48.848197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.848686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.849126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:48.849825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:48.850285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:48.850713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.004610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:49.010030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92d949d6-d3f0-4e9c-8d10-68a0db0df1dd tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.173355 Aug 31 19:31:49.010607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 377/745] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:48 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:49.660315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:49.660954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:49.667937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:49.668427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:49.668874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.669584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:49.670047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:49.670482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:49.816447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:49.824510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2fdc1757-cc0b-44a6-b6f4-46c6ff3f478a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1264 microversion: 2.1 time: 0.168951 Aug 31 19:31:49.825186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 369/746] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:49 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:50.031764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:50.032302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:50.039070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.039558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.039995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.040693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.041149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.041583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.187418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:50.196419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2cc549ac-5c73-4a34-8f18-7653135adb51 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.168747 Aug 31 19:31:50.197004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 378/747] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:50 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:31:50.847192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:50.847811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:50.854585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.855053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.855499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.856205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:50.856666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:50.857099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:50.989624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:50.997380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-157ee175-868f-45a5-a273-568d2d292d44 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1450 microversion: 2.1 time: 0.155028 Aug 31 19:31:50.997933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 370/748] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:50 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:51.018380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:51.019028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:51.024997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:51.025483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:51.026072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:51.026623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:51.027113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:51.027544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:51.164906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:51.168754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:51.173481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-340253e7-9331-416f-a2cf-85e437ef1765 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1450 microversion: 2.1 time: 0.159594 Aug 31 19:31:51.174070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 379/749] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:51 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:51.277331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:51.277987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:51.284648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:51.285139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:51.285583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:51.286420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:51.286758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:51.287217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:51.291414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:31:51.435163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:51.444371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-672ca1fc-7a4b-4571-b4bb-a199072360ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.170919 Aug 31 19:31:51.444945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 371/750] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:51 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:52.466577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:52.467242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:52.474820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:52.475539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:52.476300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:52.477597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:52.478109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:52.478553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:52.931306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:52.938416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f4690bf9-3e68-45bd-b7b6-69b1a4b835ba tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1756 microversion: 2.1 time: 0.476526 Aug 31 19:31:52.949813 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 380/751] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:52 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1756 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:31:53.330486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-ad5edf50-b527-4598-a945-29f1ce44f95a req-398032dd-03e1-4814-8959-8b5aa90c512e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1b1d14-7d79-404f-865d-c089acfe0f07", "tag": "e63545f3-23e2-4661-adee-df5faf473949"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:31:53.341375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-ad5edf50-b527-4598-a945-29f1ce44f95a req-398032dd-03e1-4814-8959-8b5aa90c512e service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:53.341858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-ad5edf50-b527-4598-a945-29f1ce44f95a req-398032dd-03e1-4814-8959-8b5aa90c512e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:53.342426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-ad5edf50-b527-4598-a945-29f1ce44f95a req-398032dd-03e1-4814-8959-8b5aa90c512e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:53.355634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-ad5edf50-b527-4598-a945-29f1ce44f95a req-398032dd-03e1-4814-8959-8b5aa90c512e service nova] Creating event network-changed:e63545f3-23e2-4661-adee-df5faf473949 for instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 on hv-cinder-85220 Aug 31 19:31:53.361433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-ad5edf50-b527-4598-a945-29f1ce44f95a req-398032dd-03e1-4814-8959-8b5aa90c512e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034147 Aug 31 19:31:53.362227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 372/752] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:31:53.961567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:31:53.962288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:31:53.969383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:53.970222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:53.970694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:53.971379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:31:53.971847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:31:53.972284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:31:54.132359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:31:54.139565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d9007309-7d66-405b-b79f-79832d461365 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1759 microversion: 2.1 time: 0.182209 Aug 31 19:31:54.140156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 381/753] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:31:53 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:02.586538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:32:02.588881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments/2fa76219-99e1-4908-aa94-acdf03074ca0 (ip 10.222.0.59) !!! Aug 31 19:32:02.592913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:02.593491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:02.601849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:02.602336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:02.602771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:02.603488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:02.604406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:02.604406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:02.633695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2427a92f-b9d9-4855-bd5a-2282d9dc8e50 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments/2fa76219-99e1-4908-aa94-acdf03074ca0" status: 200 len: 194 microversion: 2.20 time: 0.049191 Aug 31 19:32:02.634305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 373/754] 10.222.0.59 () {60 vars in 1454 bytes} [Wed Aug 31 19:32:02 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments/2fa76219-99e1-4908-aa94-acdf03074ca0 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:32:02.701782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:02.702317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:02.705767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:32:02.705917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:32:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments/2fa76219-99e1-4908-aa94-acdf03074ca0 (ip 10.222.0.59) !!! Aug 31 19:32:02.711878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:02.712358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:02.712800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:02.713493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:02.713945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:02.714371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:02.846317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lazy-loading 'services' on Instance uuid e6b4eccf-f5b2-4847-8f27-6202e7c2a81a {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:03.074014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ae33719b-3fcc-43bc-b861-e5567d63a5a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments/2fa76219-99e1-4908-aa94-acdf03074ca0" status: 202 len: 0 microversion: 2.20 time: 0.376035 Aug 31 19:32:03.074631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 382/755] 10.222.0.59 () {60 vars in 1457 bytes} [Wed Aug 31 19:32:02 2022] DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments/2fa76219-99e1-4908-aa94-acdf03074ca0 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:32:03.084603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:03.086779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:03.093334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:03.093828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:03.094273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:03.095689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:03.096393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:03.096783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:03.126853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6f1dc805-95db-4f8f-bc1a-6d8c83e03ee7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047438 Aug 31 19:32:03.127431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 374/756] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 31 19:32:03 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:32:04.140330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:04.143496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:04.155053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:04.155053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:04.155053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:04.155053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:04.155500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:04.155500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:04.184453 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f03cb964-3268-4389-848c-591621ff8214 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049076 Aug 31 19:32:04.185014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 383/757] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 31 19:32:04 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:32:05.197821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:05.199973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:05.207125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:05.207619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:05.208060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:05.208771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:05.209227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:05.209651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:05.239742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e07eff1c-dbe8-40df-a37d-4a154f870213 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046072 Aug 31 19:32:05.240302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 375/758] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 31 19:32:05 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:05.306333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:05.306914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:05.313169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:05.314526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:05.315162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:05.316300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:05.317031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:05.317482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:05.342836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:32:05.645746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-98950fec-1b6c-45cd-93d3-dd601909401c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 204 len: 0 microversion: 2.20 time: 0.343472 Aug 31 19:32:05.646445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 384/759] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 31 19:32:05 2022] DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:32:05.659343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:05.659981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:05.666358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:05.666842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:05.667365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:05.668067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:05.668528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:05.669051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:05.811846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:05.820624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:05.822056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:05.823244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ce27ad92-945e-4b18-855d-20ea5419c478 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.168483 Aug 31 19:32:05.823799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 376/760] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:05 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:32:06.847557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:06.848283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:06.854620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:06.855135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:06.855646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:06.856284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:06.856745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:06.857154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:06.987995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:06.996041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:06.997471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:06.998620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f5dfb22d-8fcc-4a7f-839c-a2b7ab408313 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.155609 Aug 31 19:32:06.999228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 385/761] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:06 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:08.022777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:08.023331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:08.030000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:08.030484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:08.030942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:08.031644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:08.032125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:08.032558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:08.161198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:08.169246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:08.170693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:08.171901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e657d69-88e1-4dce-80e5-feb5056486b9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1726 microversion: 2.20 time: 0.153407 Aug 31 19:32:08.172463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 377/762] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:08 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:09.196223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:09.196855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:09.203513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:09.204571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:09.205031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:09.205776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:09.206229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:09.206738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:09.273596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:09.281850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:09.284162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:09.285341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0271f33c-7f60-4d11-8f2b-b7444fd51c90 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1658 microversion: 2.20 time: 0.093399 Aug 31 19:32:09.285908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 386/763] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:09 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1658 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:09.395454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-fe1074ba-c952-440c-86f2-e088e4c40692 req-537a7a9a-0606-4189-b0b7-6bd6605724e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b4eccf-f5b2-4847-8f27-6202e7c2a81a", "name": "network-vif-deleted", "tag": "7ec0e43a-c2b2-46e1-aeb2-e2e257a52971"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:09.405120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-fe1074ba-c952-440c-86f2-e088e4c40692 req-537a7a9a-0606-4189-b0b7-6bd6605724e4 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:09.405610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-fe1074ba-c952-440c-86f2-e088e4c40692 req-537a7a9a-0606-4189-b0b7-6bd6605724e4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:09.406127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-fe1074ba-c952-440c-86f2-e088e4c40692 req-537a7a9a-0606-4189-b0b7-6bd6605724e4 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:09.419789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-fe1074ba-c952-440c-86f2-e088e4c40692 req-537a7a9a-0606-4189-b0b7-6bd6605724e4 service nova] Creating event network-vif-deleted:7ec0e43a-c2b2-46e1-aeb2-e2e257a52971 for instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a on hv-cinder-85220 Aug 31 19:32:09.425237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-fe1074ba-c952-440c-86f2-e088e4c40692 req-537a7a9a-0606-4189-b0b7-6bd6605724e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034381 Aug 31 19:32:09.426284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 378/764] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:10.307911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:10.308520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:10.316976 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:10.317587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:10.318308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:10.319158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:10.319631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:10.320068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:10.359334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:10.359833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:10.360937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:10.361433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lazy-loading 'fault' on Instance uuid e6b4eccf-f5b2-4847-8f27-6202e7c2a81a {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:10.407827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:10.417870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:10.419514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:10.420920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-95209ad0-2574-4dd5-ac68-acac9e9c92ee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 200 len: 1372 microversion: 2.20 time: 0.116646 Aug 31 19:32:10.421488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 387/765] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:10 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:11.445668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:11.446353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:11.452544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:11.453034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:11.453476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:11.454187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:11.454642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:11.455104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:11.468392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] HTTP exception thrown: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Request method failure captured: Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a HTTP/1.1 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WXVmz_gpBCYe66_i2KIbHso51-1r0bFPXWBq36lOg9NvyMUeirJa3u6ePAQkddiGMsQuhPfPd-5t6SckvbC8eXxWc1FCH_YH7Rwokf8Kl1mwABK9H9gfkDvHPnBMP427LMWlGu0oERHxerPbUimeZdZVKZz3zhGpWwJvKZn00N_-g Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:32:11.470248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4b5588a49a314579a29bad0f73aae8b4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 0d5336bcea514f378e06737680ae9bdc Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:32:11.472119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'e6b4eccf-f5b2-4847-8f27-6202e7c2a81a'} Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:32:11.473225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:32:11.474730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:11.476424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Returning 404 to user: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:32:11.476424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09ad55cd-90aa-4be3-8ae3-93d3a3306a6f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 404 len: 111 microversion: 2.20 time: 0.030757 Aug 31 19:32:11.476424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 379/766] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:11 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:32:11.480565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5b900322-81a6-4b3e-9093-4b9ab96ebfc0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '.version_select at 0x7ff6cb3303a0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:11.557984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5b900322-81a6-4b3e-9093-4b9ab96ebfc0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753768347" status: 204 len: 0 microversion: 2.20 time: 0.081120 Aug 31 19:32:11.558563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 388/767] 10.222.0.59 () {60 vars in 1262 bytes} [Wed Aug 31 19:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753768347 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:32:12.364558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7d742d47-d14b-45e6-bf86-b661fb2fab94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'create', calling method: .version_select at 0x7ff6cb3d1790>, body: {"keypair": {"name": "tempest-keypair-101265006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGd/rEuhind61q6tINd2aBxEbo5zmClSfI/fombyzoGP5WCd7x+JLwYDyBH71HwOn+VQ91Rh5HECFM3cuFa4aTWWT50xGOaRWzhVRp0PQLQDL6RAi4/Puhe1A0LQ0c5PCQ=="}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:12.380483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-7d742d47-d14b-45e6-bf86-b661fb2fab94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:32:12.384171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-7d742d47-d14b-45e6-bf86-b661fb2fab94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for user 0d5336bcea514f378e06737680ae9bdc and project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:32:12.466936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7d742d47-d14b-45e6-bf86-b661fb2fab94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.107173 Aug 31 19:32:12.467611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 380/768] 10.222.0.59 () {62 vars in 1200 bytes} [Wed Aug 31 19:32:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 19:32:14.880523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1051578435", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c2905708-4aef-4255-8fe7-eac971d81d06"}], "security_groups": [{"name": "tempest-securitygroup--1252334168"}], "key_name": "tempest-keypair-101265006", "user_data": "}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:14.988415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] validate_networks() for [('c2905708-4aef-4255-8fe7-eac971d81d06', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:32:15.365020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:32:15.365389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:32:15.365865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:32:15.366305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:32:15.366722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:32:15.376365 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:15.377239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:15.377690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:15.378428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:15.378911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:15.379350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:15.397094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:32:15.401048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Getting quotas for user 0d5336bcea514f378e06737680ae9bdc and project 4b5588a49a314579a29bad0f73aae8b4. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:32:15.412267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:32:15.414783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:32:15.581368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4ef6fcca-3bbf-46ec-b6d6-60a16fa37231 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.706507 Aug 31 19:32:15.587769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 389/769] 10.222.0.59 () {62 vars in 1188 bytes} [Wed Aug 31 19:32:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 19:32:15.594472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-83bc8de7-ef8a-46b1-a643-726c0e375ea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:15.595202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-83bc8de7-ef8a-46b1-a643-726c0e375ea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:15.653896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-83bc8de7-ef8a-46b1-a643-726c0e375ea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:15.662594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-83bc8de7-ef8a-46b1-a643-726c0e375ea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:15.664130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-83bc8de7-ef8a-46b1-a643-726c0e375ea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:15.665281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-83bc8de7-ef8a-46b1-a643-726c0e375ea8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1281 microversion: 2.20 time: 0.076247 Aug 31 19:32:15.665941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 381/770] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:15 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:16.688344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:16.689069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:16.695991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:16.697692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:16.697692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:16.697692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:16.698259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:16.698689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:16.762846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:16.772272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:16.773715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:16.774818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b048b0cc-357b-468b-a341-a38dc58aa105 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1285 microversion: 2.20 time: 0.090674 Aug 31 19:32:16.775415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 390/771] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:16 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:17.798169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:17.798768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:17.801349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:17.806002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:17.806491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:17.806964 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:17.807666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:17.808123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:17.808556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:17.871167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:17.879879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:17.881353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:17.882856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-061e68ef-66e4-42a4-b798-72b9eedaaeb4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1333 microversion: 2.20 time: 0.089267 Aug 31 19:32:17.883443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 382/772] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:17 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:18.905898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:18.906507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:18.909330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:18.913999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:18.914479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:18.914949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:18.915738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:18.916192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:18.916614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:19.124869 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:19.134202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:19.135662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:19.136773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-82a8d4e8-751a-454d-9309-e92c8079fb71 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.234820 Aug 31 19:32:19.138083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 391/773] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:18 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:19.880534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-01c00ed6-7c25-468b-9873-ea273c6ff63a req-b7863a3d-733f-4426-ac3b-4e781ab3d608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:19.892145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-01c00ed6-7c25-468b-9873-ea273c6ff63a req-b7863a3d-733f-4426-ac3b-4e781ab3d608 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:19.892717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-01c00ed6-7c25-468b-9873-ea273c6ff63a req-b7863a3d-733f-4426-ac3b-4e781ab3d608 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:19.893221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-01c00ed6-7c25-468b-9873-ea273c6ff63a req-b7863a3d-733f-4426-ac3b-4e781ab3d608 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:19.905672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-01c00ed6-7c25-468b-9873-ea273c6ff63a req-b7863a3d-733f-4426-ac3b-4e781ab3d608 service nova] Creating event network-changed:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:32:19.911040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-01c00ed6-7c25-468b-9873-ea273c6ff63a req-b7863a3d-733f-4426-ac3b-4e781ab3d608 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034274 Aug 31 19:32:19.911632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 383/774] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:20.161239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:20.161875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:20.169053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:20.169537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:20.169969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:20.170667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:20.171143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:20.178989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:20.250836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:20.251602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:20.258176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:20.258715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:20.259208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:20.259926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:20.260432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:20.260910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:20.339489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:20.349845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:20.351712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:20.352912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75f57d02-ad4f-4a68-8ce7-5da78995a20d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.195785 Aug 31 19:32:20.353479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 392/775] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:20 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:32:20.366675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'services' on Instance uuid ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:20.554858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6a19b9d0-3c56-4cd1-9181-f8b30306772b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments/51957485-554f-43da-bc4d-7071257baf2a" status: 202 len: 0 microversion: 2.1 time: 0.308519 Aug 31 19:32:20.555924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 384/776] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:32:20 2022] DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments/51957485-554f-43da-bc4d-7071257baf2a => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:32:20.566386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:20.568962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:20.575906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:20.576448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:20.576877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:20.577591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:20.578050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:20.578509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:20.613889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fe3273c5-f6d1-45da-be83-24d39b3d2568 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052992 Aug 31 19:32:20.614460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 393/777] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:20 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:21.380739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:21.381433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:21.387617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:21.388091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:21.388524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:21.389211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:21.389663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:21.390085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:21.394260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:21.525163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:21.533952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:21.535357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:21.536514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6c532033-c213-40cf-b47a-37475a84c5e2 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.161453 Aug 31 19:32:21.537079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 385/778] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:21 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:21.626915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:21.629090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:21.635818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:21.636303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:21.636746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:21.637449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:21.637919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:21.638343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:21.668635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d6e22e42-d12e-4e04-90e7-93d5ec70f164 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Aug 31 19:32:21.669778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 394/779] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:21 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:22.559198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:22.559770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:22.567585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:22.568081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:22.568519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:22.569228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:22.569685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:22.570114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:22.682002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:22.687084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:22.691300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:22.691789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:22.692233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:22.692940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:22.693397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:22.693847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:22.697599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:22.712010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:22.723181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:22.724730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:22.725859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-55741d06-100d-40fb-b67a-20edee906202 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.170702 Aug 31 19:32:22.726623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 386/780] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:22 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:22.726786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-42a6382e-02ee-41e5-abb2-0f139e54864b tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049029 Aug 31 19:32:22.727352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 395/781] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:22 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:32:23.739974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:23.742240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:23.747844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:23.748454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:23.748848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:23.749344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:23.749791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:23.750863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:23.751348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:23.751784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:23.755955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:23.756462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:23.756876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:23.757572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:23.758025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:23.758449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:23.783714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5d8701f0-775d-4087-a861-3fd251d39937 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 Aug 31 19:32:23.784612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 387/782] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:23 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:23.892533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:23.900835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:23.902433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:23.903672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9417ffab-750b-467a-bd66-c9e85a09fdd9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.159705 Aug 31 19:32:23.904294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 396/783] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:23 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:32:24.795723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:24.798049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:24.810587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:24.811104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:24.811724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:24.812540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:24.813488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:24.813995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:24.845589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ab01a6a6-dd7e-4a29-aee1-7b211ae71712 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053755 Aug 31 19:32:24.846148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 388/784] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:24 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:24.926862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:24.927475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:24.933774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:24.934258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:24.935775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:24.935775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:24.935973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:24.936269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:25.072188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:25.081594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:25.083146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:25.084343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75ac2ab0-f6c5-4969-9ac6-3786b1af9317 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.161429 Aug 31 19:32:25.084910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 397/785] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:24 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:25.857794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:25.860015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:25.862036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:25.867175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:25.867672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:25.868163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:25.868898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:25.869355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:25.869778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:25.901323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0e68be52-b4b4-4ad9-a636-fe855b0f8b12 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047395 Aug 31 19:32:25.901927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 389/786] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:25 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:32:25.981239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:25.981769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:25.983528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:25.984207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:25.989757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:25.992235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:25.992235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:25.992235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:25.992235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:25.992638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:26.019074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:32:26.107790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:26.108394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:26.114902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:26.115385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:26.115829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:26.116535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:26.117124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:26.117552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:26.248562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:26.258812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:26.260306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:26.261588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fe839d34-f187-414b-aec1-c68da2dc02af tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.157680 Aug 31 19:32:26.262350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 390/787] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:26 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:32:26.379695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-61e16599-2185-4e3e-b3ad-3dad5895836d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 204 len: 0 microversion: 2.1 time: 0.402096 Aug 31 19:32:26.380332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 398/788] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:32:25 2022] DELETE /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:32:26.388263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:26.389931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:26.395279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:26.395769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:26.396212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:26.396917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:26.397384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:26.397821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:26.539556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:26.550833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ed2d84b0-79e8-40bb-a3ec-c7d646570969 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1691 microversion: 2.1 time: 0.166381 Aug 31 19:32:26.551440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 391/789] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:26 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:27.286641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:27.288252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:27.295927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:27.298077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:27.298077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:27.298077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:27.298423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:27.298711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:27.399146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-5b576691-9065-4319-b651-2480b9f604ae req-182641db-ec7a-427d-9cd8-f55ae677cf2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "name": "network-vif-plugged", "status": "completed", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:27.415688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5b576691-9065-4319-b651-2480b9f604ae req-182641db-ec7a-427d-9cd8-f55ae677cf2d service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:27.416690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5b576691-9065-4319-b651-2480b9f604ae req-182641db-ec7a-427d-9cd8-f55ae677cf2d service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:27.417434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5b576691-9065-4319-b651-2480b9f604ae req-182641db-ec7a-427d-9cd8-f55ae677cf2d service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:27.435067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-5b576691-9065-4319-b651-2480b9f604ae req-182641db-ec7a-427d-9cd8-f55ae677cf2d service nova] Creating event network-vif-plugged:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:32:27.442013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-5b576691-9065-4319-b651-2480b9f604ae req-182641db-ec7a-427d-9cd8-f55ae677cf2d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046337 Aug 31 19:32:27.443043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 392/790] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:32:27.577068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:27.578042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:27.585658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:27.586159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:27.586605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:27.587371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:27.587818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:27.588427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:27.616959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:27.626483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:27.627979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:27.629195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1eb9a3b8-b254-489d-8131-81d4913d78c1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.347931 Aug 31 19:32:27.629753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 399/791] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:27 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:27.732614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:27.741869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9e3b6f27-06b3-4099-9a30-9dbdf00fb514 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1691 microversion: 2.1 time: 0.169800 Aug 31 19:32:27.742446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 393/792] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:27 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:32:28.652735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:28.653381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:28.666191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:28.666819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:28.667297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:28.668023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:28.668482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:28.668908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:28.769128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:28.769743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:28.776319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:28.783045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:28.783045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:28.783045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:28.783045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:28.783592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:28.804381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:28.812971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:28.814419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:28.815603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04c5c675-85b1-4047-bc50-677f75895ddc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.166820 Aug 31 19:32:28.816166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 400/793] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:28 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:28.915709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:28.923916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3e82eb02-e18f-400c-be21-a089975978c2 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1691 microversion: 2.1 time: 0.159453 Aug 31 19:32:28.924491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 394/794] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:28 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:29.838205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:29.838951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:29.846235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:29.846850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:29.847336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:29.848054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:29.848517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:29.848953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:29.945735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:29.946340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:29.952808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:29.953437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:29.953791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:29.954512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:29.955012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:29.955441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:29.986350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:29.995078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:29.996709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:29.997917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ed0e4756-9f89-4e5f-9ef9-d15eb65c399b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.163682 Aug 31 19:32:29.998704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 401/795] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:29 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:30.108375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:30.117539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-64376c2c-b734-4cab-9865-669e05748921 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1691 microversion: 2.1 time: 0.175568 Aug 31 19:32:30.118298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 395/796] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:29 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:32:31.020921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:31.021542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:31.028960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:31.029458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:31.029916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:31.030617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:31.031131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:31.031566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:31.139232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:31.139887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:31.151329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:31.151329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:31.151329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:31.151329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:31.151702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:31.151702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:31.219279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:31.227672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-60450efe-d7d7-4917-af97-d480f8f4956d tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1623 microversion: 2.1 time: 0.092646 Aug 31 19:32:31.228253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 396/797] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:31 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:31.269677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:31.280340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:31.282691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:31.284092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-994df853-c6f9-44ad-a5dc-b14fa007ba94 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.267114 Aug 31 19:32:31.284924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 402/798] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:31 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:31.496337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-a3b6cda7-13e2-4d76-baa9-ae90a08913b2 req-792c8c10-b662-4cc6-936e-56e8f2ab8065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfd4317-2f4a-492d-a077-f5a77c2fc9e6", "name": "network-vif-deleted", "tag": "3b5690b6-4b17-4483-8488-59210ca2f88f"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:31.508103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-a3b6cda7-13e2-4d76-baa9-ae90a08913b2 req-792c8c10-b662-4cc6-936e-56e8f2ab8065 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:31.508679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-a3b6cda7-13e2-4d76-baa9-ae90a08913b2 req-792c8c10-b662-4cc6-936e-56e8f2ab8065 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:31.509124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-a3b6cda7-13e2-4d76-baa9-ae90a08913b2 req-792c8c10-b662-4cc6-936e-56e8f2ab8065 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:31.521795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-a3b6cda7-13e2-4d76-baa9-ae90a08913b2 req-792c8c10-b662-4cc6-936e-56e8f2ab8065 service nova] Creating event network-vif-deleted:3b5690b6-4b17-4483-8488-59210ca2f88f for instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 on hv-cinder-85220 Aug 31 19:32:31.527122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-a3b6cda7-13e2-4d76-baa9-ae90a08913b2 req-792c8c10-b662-4cc6-936e-56e8f2ab8065 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034473 Aug 31 19:32:31.528112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 397/799] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:32.249085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:32.249711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:32.256809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:32.257306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:32.257762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:32.258527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:32.258924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:32.259367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:32.295219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:32.295714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:32.296161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:32.297178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'fault' on Instance uuid ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:32.307872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:32.310502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:32.318231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:32.318982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:32.319428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:32.320186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:32.320648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:32.321067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:32.344993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:32.353194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a383bbfb-aeff-4048-8f47-326e6754f8dc tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1336 microversion: 2.1 time: 0.107948 Aug 31 19:32:32.353928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 403/800] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:32 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:32.462136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:32.471371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:32.472817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:32.473934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-69352f5a-3314-4dd4-af53-9de47c4bcf6b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1407 microversion: 2.20 time: 0.170520 Aug 31 19:32:32.474729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 398/801] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:32 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:33.376726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:33.377490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:33.383958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.384510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.384954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.385665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.386126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.386558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.421214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.422462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.427602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.427602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'fault' on Instance uuid ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:33.462942 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:33.471515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c3a50e0d-859d-41b5-a713-4932fe8defed tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 200 len: 1336 microversion: 2.1 time: 0.099426 Aug 31 19:32:33.472061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 404/802] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:33 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:33.496969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:33.497583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:33.504310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.504798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.505241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.505974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.506436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.506857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.640688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:33.649183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:33.650629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:33.651813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-674805f3-71ca-4f95-83bc-d2eda89ffb3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1599 microversion: 2.20 time: 0.158705 Aug 31 19:32:33.652391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 399/803] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:32:33 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:32:33.675743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:33.676354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:33.682462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.682984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.683434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.684163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:33.684620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:33.685056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:33.771434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-958fbb85-f6f9-4122-8301-a7bc0ee20869 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099015 Aug 31 19:32:33.771434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 405/804] 10.222.0.59 () {60 vars in 1316 bytes} [Wed Aug 31 19:32:33 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:32:34.492759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:34.493548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: ebfd4317-2f4a-492d-a077-f5a77c2fc9e6] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:34.499304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:34.499913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:34.500428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:34.501138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:34.501591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:34.502015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:34.517266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] HTTP exception thrown: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 could not be found. Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Request method failure captured: Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 HTTP/1.1 Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WTSwqL5fj_-7PvAGhkDP9X0avlP3tH5hgP1Gd7O66yBB0wkk28pRE7tPInpIGra5uwRIYynaiwhRzzvGg9kgRO_iP-S64n-M6Y20jU6uRFHwHZhgawtbK79TbYB6b1a8klLWfVdEeRDE034IIO7toQYxzqsca7JCLsjcVn3uz_AMs Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:32:34.519049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a7e6027f7c1241dcb09786ff94df5c2f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: d441bbdb43c5403abf8480146bc15753 Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 could not be found. Aug 31 19:32:34.520513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'ebfd4317-2f4a-492d-a077-f5a77c2fc9e6'} Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 could not be found. Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:32:34.521358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 could not be found. Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 could not be found. Aug 31 19:32:34.522686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:34.523892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Returning 404 to user: Instance ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:32:34.523892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-624d8461-f311-499e-bcae-e0ba76fd9f61 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6" status: 404 len: 111 microversion: 2.1 time: 0.031551 Aug 31 19:32:34.525553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 400/805] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:34 2022] GET /compute/v2.1/servers/ebfd4317-2f4a-492d-a077-f5a77c2fc9e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:32:34.530352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cd62a2c0-caf2-4291-a27e-8125e08001b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '.version_select at 0x7ff6cb892dc0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:34.612960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cd62a2c0-caf2-4291-a27e-8125e08001b9 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559696521" status: 202 len: 0 microversion: 2.1 time: 0.086889 Aug 31 19:32:34.613770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 406/806] 10.222.0.59 () {58 vars in 1221 bytes} [Wed Aug 31 19:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559696521 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:32:34.785489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-da5f5bac-87ff-4b93-8a28-b9c138bd6aa8 req-1423e8a6-b473-450c-b378-162a7dbba236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:34.794742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-da5f5bac-87ff-4b93-8a28-b9c138bd6aa8 req-1423e8a6-b473-450c-b378-162a7dbba236 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:34.795250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-da5f5bac-87ff-4b93-8a28-b9c138bd6aa8 req-1423e8a6-b473-450c-b378-162a7dbba236 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:34.795679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-da5f5bac-87ff-4b93-8a28-b9c138bd6aa8 req-1423e8a6-b473-450c-b378-162a7dbba236 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:34.807374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-da5f5bac-87ff-4b93-8a28-b9c138bd6aa8 req-1423e8a6-b473-450c-b378-162a7dbba236 service nova] Creating event network-changed:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:32:34.812338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-da5f5bac-87ff-4b93-8a28-b9c138bd6aa8 req-1423e8a6-b473-450c-b378-162a7dbba236 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030961 Aug 31 19:32:34.812953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 401/807] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:38.075154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:38.075729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:38.082932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:38.083461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:38.083899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:38.084601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:38.085064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:38.085497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:38.111129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:32:38.468610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7a5f0014-6774-4fd1-a847-d8724826e325 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 204 len: 0 microversion: 2.1 time: 0.397000 Aug 31 19:32:38.469197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 407/808] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:32:38 2022] DELETE /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:32:38.478575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:38.479337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:38.486016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:38.486508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:38.487073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:38.487786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:38.488277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:38.488708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:38.619360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:38.627514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3861804b-ffdc-4818-bfab-d968f0d93430 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1508 microversion: 2.1 time: 0.153897 Aug 31 19:32:38.628086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 402/809] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:38 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:39.650044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:39.650763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:39.657297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:39.657786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:39.658232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:39.658968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:39.659935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:39.660371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:39.887352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:39.895612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c521753e-9431-4c95-95e8-5bed81a9d167 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1508 microversion: 2.1 time: 0.249810 Aug 31 19:32:39.896188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 408/810] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:39 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:40.124066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-649d4f5a-e05e-418c-aa0b-ecbf1c7c7e14 req-f693d365-308e-40b9-8942-eebb24db67f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d920f4b-fb26-4da7-a545-49ccbc5fcaff", "name": "network-vif-deleted", "tag": "f411081e-0621-4211-b73b-5d11871d58bb"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:40.133850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-649d4f5a-e05e-418c-aa0b-ecbf1c7c7e14 req-f693d365-308e-40b9-8942-eebb24db67f7 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:40.134391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-649d4f5a-e05e-418c-aa0b-ecbf1c7c7e14 req-f693d365-308e-40b9-8942-eebb24db67f7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:40.134828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-649d4f5a-e05e-418c-aa0b-ecbf1c7c7e14 req-f693d365-308e-40b9-8942-eebb24db67f7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:40.146207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-649d4f5a-e05e-418c-aa0b-ecbf1c7c7e14 req-f693d365-308e-40b9-8942-eebb24db67f7 service nova] Creating event network-vif-deleted:f411081e-0621-4211-b73b-5d11871d58bb for instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff on hv-cinder-85220 Aug 31 19:32:40.151552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-649d4f5a-e05e-418c-aa0b-ecbf1c7c7e14 req-f693d365-308e-40b9-8942-eebb24db67f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031233 Aug 31 19:32:40.152316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 403/811] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:40.917071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:40.917828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:40.924498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:40.924996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:40.925443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:40.926171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:40.926638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:40.927102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:40.929884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:40.961247 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:40.961857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:40.962365 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:40.962984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'fault' on Instance uuid 2d920f4b-fb26-4da7-a545-49ccbc5fcaff {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:41.009559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:41.018090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04e7e58b-ffbf-481c-abd7-cb28382ea6f1 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 200 len: 1312 microversion: 2.1 time: 0.105015 Aug 31 19:32:41.019938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 409/812] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:40 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:42.041990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:42.042727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: 2d920f4b-fb26-4da7-a545-49ccbc5fcaff] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:42.051172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:42.051669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:42.052118 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:42.052953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:42.053468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:42.053876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:42.067681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] HTTP exception thrown: Instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff could not be found. Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Request method failure captured: Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff HTTP/1.1 Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WTSwqL5fj_-7PvAGhkDP9X0avlP3tH5hgP1Gd7O66yBB0wkk28pRE7tPInpIGra5uwRIYynaiwhRzzvGg9kgRO_iP-S64n-M6Y20jU6uRFHwHZhgawtbK79TbYB6b1a8klLWfVdEeRDE034IIO7toQYxzqsca7JCLsjcVn3uz_AMs Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:32:42.069327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a7e6027f7c1241dcb09786ff94df5c2f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: d441bbdb43c5403abf8480146bc15753 Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff could not be found. Aug 31 19:32:42.070925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '2d920f4b-fb26-4da7-a545-49ccbc5fcaff'} Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff could not be found. Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:32:42.071816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff could not be found. Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff could not be found. Aug 31 19:32:42.073331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:42.074896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Returning 404 to user: Instance 2d920f4b-fb26-4da7-a545-49ccbc5fcaff could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:32:42.074896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e719494d-9814-4a98-aa72-802a0f3db4f8 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff" status: 404 len: 111 microversion: 2.1 time: 0.033535 Aug 31 19:32:42.074896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 404/813] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:42 2022] GET /compute/v2.1/servers/2d920f4b-fb26-4da7-a545-49ccbc5fcaff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:32:42.079495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:42.080019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:42.087402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:42.087847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:42.088287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:42.089318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:42.089694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:42.090119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:42.118105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:32:42.436302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cda63bd4-907b-4141-afcf-4dca1e667561 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 204 len: 0 microversion: 2.1 time: 0.360294 Aug 31 19:32:42.436920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 410/814] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:32:42 2022] DELETE /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:32:42.446189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:42.452307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:42.452871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:42.453358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:42.453798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:42.454491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:42.454971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:42.455400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:42.593255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:42.595657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:42.603164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-551afafc-c102-4ca0-bfb3-90d2d8009f8a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.160719 Aug 31 19:32:42.603728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 405/815] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:42 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:43.627031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:43.627764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:43.634345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:43.634841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:43.635316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:43.636017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:43.636485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:43.636917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:43.771446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:43.779241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a4d61247-00c5-47b1-b3b9-79ecaed7547a tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.156530 Aug 31 19:32:43.779798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 411/816] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:43 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:44.800934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:44.801536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:44.808005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:44.808489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:44.808958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:44.809625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:44.810084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:44.810504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:44.945421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:44.953610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-335c8d06-e9a8-426e-a3e2-f8732a92f747 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1522 microversion: 2.1 time: 0.156746 Aug 31 19:32:44.954180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 406/817] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:44 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:45.975770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:45.976418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:45.983443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:45.984775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:45.984775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:45.985214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:45.985704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:45.986183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:46.079583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:46.093686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6f6a6815-682b-4b42-a81a-655777f4632c tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1480 microversion: 2.1 time: 0.122316 Aug 31 19:32:46.094026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-d8aff065-186b-4af2-bab9-ae705058eb1f req-44ad69ee-eb5a-475a-bf30-1e55333f22f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9a1dbe-59be-491e-a129-aba5a3e1fe39", "name": "network-vif-deleted", "tag": "945cd1b7-9a64-4d73-ab52-f3396a055dc3"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:46.095296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 412/818] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:45 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1480 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:46.113028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-d8aff065-186b-4af2-bab9-ae705058eb1f req-44ad69ee-eb5a-475a-bf30-1e55333f22f1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:46.113028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-d8aff065-186b-4af2-bab9-ae705058eb1f req-44ad69ee-eb5a-475a-bf30-1e55333f22f1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:46.113028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-d8aff065-186b-4af2-bab9-ae705058eb1f req-44ad69ee-eb5a-475a-bf30-1e55333f22f1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:46.120383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-d8aff065-186b-4af2-bab9-ae705058eb1f req-44ad69ee-eb5a-475a-bf30-1e55333f22f1 service nova] Creating event network-vif-deleted:945cd1b7-9a64-4d73-ab52-f3396a055dc3 for instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 on hv-cinder-85220 Aug 31 19:32:46.125431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-d8aff065-186b-4af2-bab9-ae705058eb1f req-44ad69ee-eb5a-475a-bf30-1e55333f22f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035089 Aug 31 19:32:46.126033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 407/819] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:32:47.116550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:47.117219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:47.123672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:47.124154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:47.124593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:47.125314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:47.125768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:47.126189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:47.160370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:47.160989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:47.161350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:47.161756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lazy-loading 'fault' on Instance uuid df9a1dbe-59be-491e-a129-aba5a3e1fe39 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:47.202451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd441bbdb43c5403abf8480146bc15753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e6027f7c1241dcb09786ff94df5c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:47.210470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0a65d9d6-c94b-47fa-a714-864d547f0fd5 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 200 len: 1312 microversion: 2.1 time: 0.097775 Aug 31 19:32:47.211075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 413/820] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:47 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:48.233577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:48.234416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] [instance: df9a1dbe-59be-491e-a129-aba5a3e1fe39] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:48.241072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:48.241562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:48.242004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:48.242728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:48.243218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:48.243654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:48.257728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] HTTP exception thrown: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 could not be found. Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Request method failure captured: Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 HTTP/1.1 Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WTSwqL5fj_-7PvAGhkDP9X0avlP3tH5hgP1Gd7O66yBB0wkk28pRE7tPInpIGra5uwRIYynaiwhRzzvGg9kgRO_iP-S64n-M6Y20jU6uRFHwHZhgawtbK79TbYB6b1a8klLWfVdEeRDE034IIO7toQYxzqsca7JCLsjcVn3uz_AMs Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:32:48.259381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a7e6027f7c1241dcb09786ff94df5c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a7e6027f7c1241dcb09786ff94df5c2f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a7e6027f7c1241dcb09786ff94df5c2f Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-778068649 Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: d441bbdb43c5403abf8480146bc15753 Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-778068649-project Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 could not be found. Aug 31 19:32:48.260926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'df9a1dbe-59be-491e-a129-aba5a3e1fe39'} Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 could not be found. Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:32:48.261765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 could not be found. Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 could not be found. Aug 31 19:32:48.263023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:48.264186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] Returning 404 to user: Instance df9a1dbe-59be-491e-a129-aba5a3e1fe39 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:32:48.264186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-62ca1d49-e5fe-4989-9614-a67c9e566652 tempest-ServerRescueNegativeTestJSON-778068649 tempest-ServerRescueNegativeTestJSON-778068649-project] 10.222.0.59 "GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39" status: 404 len: 111 microversion: 2.1 time: 0.032465 Aug 31 19:32:48.264186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 408/821] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:48 2022] GET /compute/v2.1/servers/df9a1dbe-59be-491e-a129-aba5a3e1fe39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:32:52.009097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:52.011561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:52.014140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:52.018842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:52.019371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:52.019969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:52.021038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:52.021507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:52.021945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:52.053852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-196f28fb-bd21-48f6-912e-266108200df7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049462 Aug 31 19:32:52.054406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 414/822] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:32:52 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:32:52.125102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:52.126195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:52.130211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=54 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:32:52.136198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:52.136695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:52.137131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:52.137827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:52.138278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:52.138699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:52.166186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:32:52.517572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7106188d-0b7b-4c5e-9b03-27e76a01ceb2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 204 len: 0 microversion: 2.1 time: 0.398854 Aug 31 19:32:52.518357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 409/823] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:32:52 2022] DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:32:52.527844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:52.528940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:52.535118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:52.536442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:52.537176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:52.537895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:52.538368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:52.538803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:52.676516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:52.684412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-eb2ca0cc-eb8d-41b5-b74c-a0f91ba1be48 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1672 microversion: 2.1 time: 0.160825 Aug 31 19:32:52.685053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 415/824] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:52 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:32:53.705967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:53.706696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:53.713377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.714117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.714547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.715281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:53.715737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:53.716178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:53.854758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:53.863041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a550536d-3751-4189-ad21-9b264f7acad7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1672 microversion: 2.1 time: 0.161186 Aug 31 19:32:53.863861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 410/825] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:53 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:54.885493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:54.886988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:54.894191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:54.895415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:54.895943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:54.896770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:54.897308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:54.897944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:55.137486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:55.146422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3569fbb9-c296-4112-99dc-c70ec364a5d9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1672 microversion: 2.1 time: 0.264839 Aug 31 19:32:55.147056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 416/826] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:54 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:55.736125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-9a18935c-b942-420c-912a-f58a977c215d req-243e3ab0-a55f-4297-b0e3-18cb3d980ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf99492-1198-453d-9f3b-f4f8bdbc225a", "name": "network-vif-deleted", "tag": "531806c1-a1f4-449c-a1b4-ec4835b2b388"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:55.746472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9a18935c-b942-420c-912a-f58a977c215d req-243e3ab0-a55f-4297-b0e3-18cb3d980ad9 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:55.746981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9a18935c-b942-420c-912a-f58a977c215d req-243e3ab0-a55f-4297-b0e3-18cb3d980ad9 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:55.747529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9a18935c-b942-420c-912a-f58a977c215d req-243e3ab0-a55f-4297-b0e3-18cb3d980ad9 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:55.763445 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-9a18935c-b942-420c-912a-f58a977c215d req-243e3ab0-a55f-4297-b0e3-18cb3d980ad9 service nova] Creating event network-vif-deleted:531806c1-a1f4-449c-a1b4-ec4835b2b388 for instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a on hv-cinder-85220 Aug 31 19:32:55.773689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-9a18935c-b942-420c-912a-f58a977c215d req-243e3ab0-a55f-4297-b0e3-18cb3d980ad9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041072 Aug 31 19:32:55.774713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 411/827] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:32:56.167837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:56.169173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:56.175698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:56.177094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:56.177494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:56.178301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:56.178771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:56.179434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:56.217927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:56.218442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:56.218902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:56.219362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lazy-loading 'fault' on Instance uuid 2cf99492-1198-453d-9f3b-f4f8bdbc225a {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:32:56.261960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:32:56.273286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75094f18-762c-4e09-8bd4-d1e70f109e82 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 200 len: 1327 microversion: 2.1 time: 0.108630 Aug 31 19:32:56.274724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 417/828] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:56 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:32:57.297231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:57.298231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:32:57.306393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:57.306944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:57.307398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:57.309867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:32:57.309867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:32:57.309867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:32:57.324186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] HTTP exception thrown: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Request method failure captured: Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a HTTP/1.1 Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WW0thITDhbmXL8Q3_vfLB6pK24byVW1EeIfVHgxwLn5FgDb1LFqJSG1j5mzWnkcuEPl16QaydQH1r9VPSrryvdiKnqtNIPMVEfxt_BIMsfmOm_ELmGRWGwBlNQMvgiT99wwM0aGI-cyqsEKT3zbE9QvwJ-AMFk6PfhLRtb2YKS09A Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:32:57.325846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a13c903a376b46508e8cccbcb20b484c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 8bc4801f1f674f55b57d49e5f09205ea Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:32:57.327608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '2cf99492-1198-453d-9f3b-f4f8bdbc225a'} Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:32:57.332017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:32:57.333853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:32:57.335254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Returning 404 to user: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:32:57.335254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-700e7289-65e7-4c83-9f07-244525ac7711 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 404 len: 111 microversion: 2.1 time: 0.035320 Aug 31 19:32:57.335254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 412/829] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:32:57 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:32:57.337377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ad700c57-7875-4abb-869b-90ec2d5ab6a7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '.version_select at 0x7ff6cb35d9d0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:32:57.448844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ad700c57-7875-4abb-869b-90ec2d5ab6a7 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-710140689" status: 202 len: 0 microversion: 2.1 time: 0.115851 Aug 31 19:32:57.453021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 418/830] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 31 19:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-710140689 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:32:58.398228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5f89e64c-7775-4aa6-900a-2eb3d552ffe9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: .version_select at 0x7ff6cb3a0e50>, body: {"keypair": {"name": "tempest-keypair-913221887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0rDbT7XDc65t9qM8sJ5UMKeIzcESDBO4/Bo5k3SgV+kzKj1iB+zdmnmB6teMMs/MB+c70Xq6fBP0Vn0EbInQfR0xGOfixfmbc3SDmA8iR3PIHflEH17LDjko8i7J+QBA=="}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:32:58.416491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-5f89e64c-7775-4aa6-900a-2eb3d552ffe9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for project a13c903a376b46508e8cccbcb20b484c. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:32:58.420868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-5f89e64c-7775-4aa6-900a-2eb3d552ffe9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for user 8bc4801f1f674f55b57d49e5f09205ea and project a13c903a376b46508e8cccbcb20b484c. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:32:58.518689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5f89e64c-7775-4aa6-900a-2eb3d552ffe9 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126133 Aug 31 19:32:58.520603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 413/831] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:32:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:00.391701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-95135aff-eb67-47d5-ba75-19430589c490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: .version_select at 0x7ff6cb52ea60>, body: {"keypair": {"name": "tempest-keypair-482102547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClHTFxN6ydZkYVsIxRnXl+ueMvfVz6pl6fzsQmYIV+pr1kVAunQJlBZ0x4oFoOFe5DtD6lH0ER1f+6TVuiZP1NMk5UEoG1ldLSvXTyuWJqMNUlFl+T/EJ66yvq/YixWgA=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:00.413032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-95135aff-eb67-47d5-ba75-19430589c490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:33:00.418856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-95135aff-eb67-47d5-ba75-19430589c490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:33:00.558263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-95135aff-eb67-47d5-ba75-19430589c490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.414469 Aug 31 19:33:00.559241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 419/832] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:33:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:01.373647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1653227795", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0e255a1b-52c7-4e9a-bc8b-eb98a8191098"}], "security_groups": [{"name": "tempest-securitygroup--191945821"}], "key_name": "tempest-keypair-913221887", "user_data": "}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:01.502108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] validate_networks() for [('0e255a1b-52c7-4e9a-bc8b-eb98a8191098', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:33:02.361646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:33:02.362245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:33:02.363257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:33:02.364330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:33:02.364823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:33:02.377941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:02.379570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:02.380387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:02.381567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:02.382404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:02.383161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:02.418609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for project a13c903a376b46508e8cccbcb20b484c. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:33:02.427894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Getting quotas for user 8bc4801f1f674f55b57d49e5f09205ea and project a13c903a376b46508e8cccbcb20b484c. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:33:02.440417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:33:02.442894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:33:02.569027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3555c8f2-a221-4288-898d-1e4d83ea53a3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.199870 Aug 31 19:33:02.570822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 414/833] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:33:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:33:02.581555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-19233445-74ca-4eb5-8340-407391980985 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:02.582853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-19233445-74ca-4eb5-8340-407391980985 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:02.672490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-19233445-74ca-4eb5-8340-407391980985 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:02.680714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-19233445-74ca-4eb5-8340-407391980985 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1237 microversion: 2.1 time: 0.103719 Aug 31 19:33:02.681985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 420/834] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:02 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1237 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:03.506024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-384186942", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e"}], "security_groups": [{"name": "tempest-securitygroup--570975461"}], "key_name": "tempest-keypair-482102547", "user_data": "}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:03.621032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] validate_networks() for [('acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:33:03.704555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:03.706661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:03.717490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:03.717994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:03.718635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:03.725834 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:03.725834 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:03.725834 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:03.788728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:03.798186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7bf67f8a-5499-4f1c-9e56-a0a4322b27f3 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1241 microversion: 2.1 time: 0.100084 Aug 31 19:33:03.798836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 421/835] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:03 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:04.069774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:33:04.073136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:33:04.073136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:33:04.073379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:33:04.074053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:33:04.086800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:04.087606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:04.088203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:04.089378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:04.089824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:04.091547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:04.109971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:33:04.116070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:33:04.129274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:33:04.131661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:33:04.301304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1270696d-4e1a-4226-bb43-0820f1f77f29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.800183 Aug 31 19:33:04.303094 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 415/836] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:33:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:33:04.319014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-13eaf9c5-5e58-4058-8be3-ff1b61312e3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:04.319014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-13eaf9c5-5e58-4058-8be3-ff1b61312e3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:04.379036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-13eaf9c5-5e58-4058-8be3-ff1b61312e3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:04.386171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-13eaf9c5-5e58-4058-8be3-ff1b61312e3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1240 microversion: 2.1 time: 0.076368 Aug 31 19:33:04.386756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 422/837] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:04 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:04.822230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:04.822230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:04.838028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:04.838834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:04.839532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:04.840331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:04.840796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:04.841232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:04.905965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:04.914798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-29452937-7c4b-4965-bff7-163c178848eb tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1289 microversion: 2.1 time: 0.099663 Aug 31 19:33:04.915408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 416/838] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:04 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:05.408651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-75e3ac55-1e9b-4d5c-a5fe-3f8e6f056365 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:05.409351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-75e3ac55-1e9b-4d5c-a5fe-3f8e6f056365 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:05.498907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-75e3ac55-1e9b-4d5c-a5fe-3f8e6f056365 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:05.509874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-75e3ac55-1e9b-4d5c-a5fe-3f8e6f056365 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1240 microversion: 2.1 time: 0.105204 Aug 31 19:33:05.513704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 423/839] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:05 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1240 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:05.935938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:05.936679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:05.943735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:05.944223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:05.944677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:05.945371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:05.945824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:05.946247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:06.014849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:06.023564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0c33fdb3-d5bd-461f-9766-0b4cfde5993f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1295 microversion: 2.1 time: 0.091364 Aug 31 19:33:06.024153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 417/840] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:05 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:06.532473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:06.533095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:06.542309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:06.543058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:06.543715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:06.544622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:06.545249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:06.545844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:06.636254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:06.645020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-116a4900-8ec0-4351-92b4-823ec800b299 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1236 microversion: 2.1 time: 0.116157 Aug 31 19:33:06.653121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 424/841] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:06 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1236 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:07.045959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:07.046564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:07.056071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.063713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.064206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.064968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.065448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.065908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.220048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:07.228553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cf50f541-6ece-4808-ae97-cfe65c851ba1 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.186490 Aug 31 19:33:07.229120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 418/842] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:07 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:07.296874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-a5d54116-87f2-465c-9241-eb8e6b54671d req-dd209d16-e839-454a-b703-cfa18d3e694f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a06384-0ef1-449c-a47a-f2fd14d9f33c", "tag": "ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:07.307645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a5d54116-87f2-465c-9241-eb8e6b54671d req-dd209d16-e839-454a-b703-cfa18d3e694f service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.308415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a5d54116-87f2-465c-9241-eb8e6b54671d req-dd209d16-e839-454a-b703-cfa18d3e694f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.308856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-a5d54116-87f2-465c-9241-eb8e6b54671d req-dd209d16-e839-454a-b703-cfa18d3e694f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.321184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-a5d54116-87f2-465c-9241-eb8e6b54671d req-dd209d16-e839-454a-b703-cfa18d3e694f service nova] Creating event network-changed:ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1 for instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c on hv-cinder-85220 Aug 31 19:33:07.326680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-a5d54116-87f2-465c-9241-eb8e6b54671d req-dd209d16-e839-454a-b703-cfa18d3e694f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033861 Aug 31 19:33:07.327332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 425/843] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:07.666734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:07.672421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:07.673712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.674204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.674644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.675374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:07.675831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:07.676288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:07.746295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:07.754751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5db79380-2069-4460-bd80-3d61cac5e25a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1292 microversion: 2.1 time: 0.091236 Aug 31 19:33:07.755734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 419/844] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:07 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:08.250600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:08.251330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:08.259439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.260121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.260629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.261400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.261914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.262482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.539786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:08.547972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4ab7e1cc-d2d6-412b-93dc-58388a0c2023 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.301600 Aug 31 19:33:08.548556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 426/845] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:08 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:08.777224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:08.777809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:08.784845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.785202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.786199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.787424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:08.787834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:08.788270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:08.856372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:08.865555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-57933006-d432-494c-943b-0d0aba1f81df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1298 microversion: 2.1 time: 0.093018 Aug 31 19:33:08.878948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 420/846] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:08 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:09.570278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:09.570925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:09.577670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:09.578171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:09.578719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:09.579499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:09.580014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:09.580453 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:09.711499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:09.719266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e36e0682-4451-479d-ad56-6231d67c83bf tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.153672 Aug 31 19:33:09.719828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 427/847] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:09 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:09.887698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:09.888241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:09.894650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:09.895250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:09.895713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:09.896429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:09.896874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:09.897308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.028214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:10.036339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e0b6cfa5-a066-43ad-8bcf-87d4e4050d06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.152544 Aug 31 19:33:10.036918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 421/848] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:09 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:10.739740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:10.740373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:10.747100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:10.747592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:10.748027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.748784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:10.749239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:10.749664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:10.889486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:10.891974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:10.899109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ac23df66-61e9-4799-a6cf-432175bdfeee tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.163234 Aug 31 19:33:10.900002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 428/849] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:10 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:11.060226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:11.060954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:11.067703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:11.068196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:11.068642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:11.069358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:11.069823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:11.070257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:11.206232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:11.216045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f987c42f-de45-4dd8-b648-8ff0884bdf14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.162037 Aug 31 19:33:11.216630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 422/850] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:11 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:11.920281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:11.920903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:11.928712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:11.929208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:11.929653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:11.930353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:11.930819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:11.931290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:12.063174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:12.071054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8b35ade4-31dc-46dd-b53f-bd130e849ef5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.154646 Aug 31 19:33:12.071621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 429/851] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:11 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:12.237661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:12.238221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:12.244996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:12.245484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:12.245927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:12.246624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:12.247114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:12.247549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:12.387897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:12.396676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ceb7d7d9-2d3f-4d24-a00c-db3d3ef4abdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.162909 Aug 31 19:33:12.397337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 423/852] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:12 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:12.578556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1366432416"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:12.579275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:12.586280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:12.586846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:12.587386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:12.588677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:12.589353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:12.589956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:12.742973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.network.security_group_api [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Removing security group 743b471f-f46f-41fa-bd37-f686ac9b9cce from port 86560688-f0cc-412f-aa9d-12bebb775652 Aug 31 19:33:13.092623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:13.093178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:13.100141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:13.100639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:13.101261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:13.101987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:13.102453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:13.102893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:13.235996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:13.249326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fddd2291-367b-4844-a852-f313b43eee3c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.156935 Aug 31 19:33:13.249326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 424/853] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:13 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:13.250152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-ebef5531-4648-4ff4-bce1-6c055a8262a6 req-b2ec2cc6-5e7d-430a-a68c-e09b04a05799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "952eb54c-5683-4fdf-ad61-7564b9dafbb5", "tag": "347cb772-84b0-4f57-ae0d-400895cb5c95"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:13.259659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-ebef5531-4648-4ff4-bce1-6c055a8262a6 req-b2ec2cc6-5e7d-430a-a68c-e09b04a05799 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:13.260136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-ebef5531-4648-4ff4-bce1-6c055a8262a6 req-b2ec2cc6-5e7d-430a-a68c-e09b04a05799 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:13.260570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-ebef5531-4648-4ff4-bce1-6c055a8262a6 req-b2ec2cc6-5e7d-430a-a68c-e09b04a05799 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:13.271737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-ebef5531-4648-4ff4-bce1-6c055a8262a6 req-b2ec2cc6-5e7d-430a-a68c-e09b04a05799 service nova] Creating event network-changed:347cb772-84b0-4f57-ae0d-400895cb5c95 for instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 on hv-cinder-85220 Aug 31 19:33:13.276618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-ebef5531-4648-4ff4-bce1-6c055a8262a6 req-b2ec2cc6-5e7d-430a-a68c-e09b04a05799 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029723 Aug 31 19:33:13.277887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 425/854] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:13.341160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b6ccec6b-dad3-46d5-bdcf-5431330b0716 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/action" status: 202 len: 0 microversion: 2.1 time: 0.766705 Aug 31 19:33:13.345360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 430/855] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:33:12 2022] POST /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:33:13.419497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:13.420596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:13.430596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:13.435221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:13.435967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:13.438759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:13.439503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:13.440124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:13.460780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:13.657249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:13.670416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a46b01c2-82e1-4907-b94e-4b2518f58092 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.256363 Aug 31 19:33:13.671460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 426/856] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:13 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:14.266273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:14.267057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:14.273905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.274492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.275545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.276799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.276799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.277311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.694481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:14.695138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:14.698362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=4 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:14.699071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=16 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:14.704950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.705707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.707722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.708845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.709503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.710129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.824052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:14.836031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-59d4ac33-e2ad-4660-90cc-6f943e7d89a8 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.573280 Aug 31 19:33:14.844714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 431/857] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:14 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:14.854928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:14.855433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:14.862551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.863074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.863756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.864721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.865350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.865945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.925190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:14.936897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6dd2d4f6-9e37-41eb-b763-72a33fa0cd58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.248862 Aug 31 19:33:14.939026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 427/858] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:14 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:14.950224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-9064b8aa-2bb3-4d55-a200-1144e6c8e6a7 req-095586ec-14b0-4fd0-8fa4-74cc058ade01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:14.956440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9064b8aa-2bb3-4d55-a200-1144e6c8e6a7 req-095586ec-14b0-4fd0-8fa4-74cc058ade01 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:14.958224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9064b8aa-2bb3-4d55-a200-1144e6c8e6a7 req-095586ec-14b0-4fd0-8fa4-74cc058ade01 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:14.958952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9064b8aa-2bb3-4d55-a200-1144e6c8e6a7 req-095586ec-14b0-4fd0-8fa4-74cc058ade01 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:14.970728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lazy-loading 'services' on Instance uuid b2c8506a-53ab-4966-adeb-4325fef54610 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:33:14.972940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-9064b8aa-2bb3-4d55-a200-1144e6c8e6a7 req-095586ec-14b0-4fd0-8fa4-74cc058ade01 service nova] Creating event network-changed:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:33:14.979007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-9064b8aa-2bb3-4d55-a200-1144e6c8e6a7 req-095586ec-14b0-4fd0-8fa4-74cc058ade01 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038431 Aug 31 19:33:14.979858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 428/859] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:15.187345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0180edd1-a2a6-4e5a-b434-bfb45b0d448a tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments/0275cff0-138a-471f-b014-01299d74c10b" status: 202 len: 0 microversion: 2.1 time: 0.339200 Aug 31 19:33:15.188180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 432/860] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:33:14 2022] DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments/0275cff0-138a-471f-b014-01299d74c10b => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:33:15.197592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:15.200144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:15.206405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.206913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.208197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:15.208892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.209364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.209835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:15.240625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e6c2f347-917f-4472-b4fc-fab9c4f307d7 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047369 Aug 31 19:33:15.241197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 429/861] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:33:15 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:15.292877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-04445f73-c77c-4b9b-87dc-26426e4a0109 req-1a5f3315-472e-4589-b870-4c633eb7c463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:15.303894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-04445f73-c77c-4b9b-87dc-26426e4a0109 req-1a5f3315-472e-4589-b870-4c633eb7c463 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.304385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-04445f73-c77c-4b9b-87dc-26426e4a0109 req-1a5f3315-472e-4589-b870-4c633eb7c463 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.304823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-04445f73-c77c-4b9b-87dc-26426e4a0109 req-1a5f3315-472e-4589-b870-4c633eb7c463 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:15.316404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-04445f73-c77c-4b9b-87dc-26426e4a0109 req-1a5f3315-472e-4589-b870-4c633eb7c463 service nova] Creating event network-changed:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:33:15.322375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-04445f73-c77c-4b9b-87dc-26426e4a0109 req-1a5f3315-472e-4589-b870-4c633eb7c463 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034103 Aug 31 19:33:15.323000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 433/862] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:15.860262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:15.861140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:15.869561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.870060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.870575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:15.871393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.871940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.872439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:15.970194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:15.970907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:15.973474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=10 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:15.978418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.978864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.979332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:15.980036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:15.980493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:15.980952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:16.007484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:16.015355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-53eee08a-dbc3-4474-a5e2-4528a490debc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.159650 Aug 31 19:33:16.015934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 430/863] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:15 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:16.113099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:16.121226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-39e5c0f9-2eeb-4d3e-a8e8-3287d2eddd18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.155131 Aug 31 19:33:16.121790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 434/864] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:15 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:16.253150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:16.255371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:16.261275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:16.261753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:16.262182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:16.263016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:16.263472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:16.263896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:16.294804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-178bf565-be6c-4d43-94b9-ae4f07049826 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 Aug 31 19:33:16.295386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 431/865] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:33:16 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:16.743396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-75aa9744-3a3d-4580-bf89-5e254c9a6c10 req-12404ef9-ae11-4ff8-8f82-794cebeb8f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a06384-0ef1-449c-a47a-f2fd14d9f33c", "name": "network-vif-plugged", "status": "completed", "tag": "ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:16.754295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-75aa9744-3a3d-4580-bf89-5e254c9a6c10 req-12404ef9-ae11-4ff8-8f82-794cebeb8f86 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:16.755438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-75aa9744-3a3d-4580-bf89-5e254c9a6c10 req-12404ef9-ae11-4ff8-8f82-794cebeb8f86 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:16.755438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-75aa9744-3a3d-4580-bf89-5e254c9a6c10 req-12404ef9-ae11-4ff8-8f82-794cebeb8f86 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:16.766547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-75aa9744-3a3d-4580-bf89-5e254c9a6c10 req-12404ef9-ae11-4ff8-8f82-794cebeb8f86 service nova] Creating event network-vif-plugged:ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1 for instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c on hv-cinder-85220 Aug 31 19:33:16.772178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-75aa9744-3a3d-4580-bf89-5e254c9a6c10 req-12404ef9-ae11-4ff8-8f82-794cebeb8f86 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 Aug 31 19:33:16.784181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 435/866] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:17.036026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:17.036580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:17.043382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:17.043875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:17.044317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:17.045018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:17.045508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:17.045938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:17.142761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:17.143531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:17.150500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:17.151927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:17.151927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:17.152355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:17.154333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:17.154333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:17.183496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:17.191444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fa86352a-58dd-4f7c-99ac-370509070b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.159501 Aug 31 19:33:17.192158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 432/867] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:17 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:17.297847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:17.306682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ec4d3892-b78d-43fb-ae2d-6ecfb993546b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.168420 Aug 31 19:33:17.307297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 436/868] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:17 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:17.307727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:17.309906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:17.316017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:17.316546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:17.317074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:17.318081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:17.318321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:17.318746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:17.349375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ab038f26-a5f2-47ec-a666-7d3698e29452 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Aug 31 19:33:17.349938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 433/869] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:33:17 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:18.213198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:18.215009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:18.222117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:18.222910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:18.223660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:18.224602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:18.225132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:18.226016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:18.327780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:18.328514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:18.335317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:18.335816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:18.336302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:18.337010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:18.337477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:18.338151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:18.365279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:18.377594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9a2efc23-7fa0-4357-b014-7356bd28b15e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.168505 Aug 31 19:33:18.386704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 437/870] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:18 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:18.386704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:18.386704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:18.392642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:18.393137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:18.393581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:18.394362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:18.394832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:18.395527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:18.425522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-570fe408-5ed3-488f-b471-e0c69a59e65b tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Aug 31 19:33:18.427341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 438/871] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:33:18 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:18.471850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:18.479894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f09c9496-3708-4c58-bcc6-2553a2333500 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.155959 Aug 31 19:33:18.480586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 434/872] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:18 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:19.398970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:19.399595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:19.406139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:19.406636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:19.409492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:19.409492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:19.409492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:19.409492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:19.438339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:19.441163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:19.444465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:19.449318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:19.450003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:19.450450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:19.451212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:19.451687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:19.452119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:19.488870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6ebfb0d2-4122-4dd2-a40a-de732dfddb1f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049515 Aug 31 19:33:19.488870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 435/873] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:33:19 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:19.501103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:19.501724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:19.508278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:19.508698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:19.509142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:19.510016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:19.510479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:19.510930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:19.576724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:19.584956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6105b0b9-840c-45ad-810e-7ebdbe06d12b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.189824 Aug 31 19:33:19.585534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 439/874] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:19 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:19.654308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:19.663020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ed25d69c-0b61-4a87-9292-dd63f13e1066 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.165684 Aug 31 19:33:19.664107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 436/875] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:19 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:20.497960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:20.500854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:20.515295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.515949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.516539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.517525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.518099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.518653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.552357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5bee2fdd-f5e0-46ce-9908-26f6c98ebe84 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058850 Aug 31 19:33:20.553046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 440/876] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:33:20 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:33:20.563835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:20.564498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:20.571529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.572019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.572463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.573175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.573634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.574192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.606513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:20.606909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:20.614488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.615043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.616096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.621162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.621162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.621162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.665838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] HTTP exception thrown: Instance b2c8506a-53ab-4966-adeb-4325fef54610 is not attached to volume 0275cff0-138a-471f-b014-01299d74c10b Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Request method failure captured: Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments/0275cff0-138a-471f-b014-01299d74c10b HTTP/1.1 Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7ZnfSb3QdhB8pZudjgUp8ucd3ZScdekE3seZqhdPYtFU1dStRLpJowIHJlOancP4hwj8WGiSj5fSeFWob2J5eo66utdaZdSp8lhxCyi2qArKe_YAsOcUbSp91dBUFiGb2rFshs18UPDVnQ11mTHuvG6UHwN8-Xw0s9iDZVkGCtKJqU Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b59a32b67fde4526bbb78d6e0a1cebda Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-TestMinimumBasicScenario-1432602417 Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:33:20.668801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b59a32b67fde4526bbb78d6e0a1cebda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b59a32b67fde4526bbb78d6e0a1cebda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b59a32b67fde4526bbb78d6e0a1cebda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b59a32b67fde4526bbb78d6e0a1cebda", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-TestMinimumBasicScenario-1432602417 Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b59a32b67fde4526bbb78d6e0a1cebda Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1432602417 Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-TestMinimumBasicScenario-1432602417-project Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: ca526289756647429b819f466da8941f Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-TestMinimumBasicScenario-1432602417-project Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:33:20.676072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance b2c8506a-53ab-4966-adeb-4325fef54610 is not attached to volume 0275cff0-138a-471f-b014-01299d74c10b Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'server_id': 'b2c8506a-53ab-4966-adeb-4325fef54610', 'id': '0275cff0-138a-471f-b014-01299d74c10b'} Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0275cff0-138a-471f-b014-01299d74c10b. Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:33:20.677683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c8506a-53ab-4966-adeb-4325fef54610 is not attached to volume 0275cff0-138a-471f-b014-01299d74c10b Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c8506a-53ab-4966-adeb-4325fef54610 is not attached to volume 0275cff0-138a-471f-b014-01299d74c10b Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:20.679939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Returning 404 to user: Instance b2c8506a-53ab-4966-adeb-4325fef54610 is not attached to volume 0275cff0-138a-471f-b014-01299d74c10b {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:33:20.681758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4fbdf9f2-e496-40fb-872a-34101b33cd26 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments/0275cff0-138a-471f-b014-01299d74c10b" status: 404 len: 154 microversion: 2.1 time: 0.110718 Aug 31 19:33:20.681758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 437/877] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:33:20 2022] DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610/os-volume_attachments/0275cff0-138a-471f-b014-01299d74c10b => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:20.688480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:20.691231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:20.698779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.699316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.699860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.701171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.701812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.702554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.839371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:20.839371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-52155c1b-4952-4ffc-886d-86c3eb03fb79 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1362 microversion: 2.1 time: 0.229394 Aug 31 19:33:20.839371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 441/878] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:20 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:33:20.839830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-cae9c899-51d8-40aa-94ee-1ef206c06adc req-4ce65024-8590-406a-a6c0-f42a6b2cb7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952eb54c-5683-4fdf-ad61-7564b9dafbb5", "name": "network-vif-plugged", "status": "completed", "tag": "347cb772-84b0-4f57-ae0d-400895cb5c95"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:20.847427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-cae9c899-51d8-40aa-94ee-1ef206c06adc req-4ce65024-8590-406a-a6c0-f42a6b2cb7f1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:20.847935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-cae9c899-51d8-40aa-94ee-1ef206c06adc req-4ce65024-8590-406a-a6c0-f42a6b2cb7f1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:20.848374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-cae9c899-51d8-40aa-94ee-1ef206c06adc req-4ce65024-8590-406a-a6c0-f42a6b2cb7f1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:20.860921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-cae9c899-51d8-40aa-94ee-1ef206c06adc req-4ce65024-8590-406a-a6c0-f42a6b2cb7f1 service nova] Creating event network-vif-plugged:347cb772-84b0-4f57-ae0d-400895cb5c95 for instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 on hv-cinder-85220 Aug 31 19:33:20.866706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-cae9c899-51d8-40aa-94ee-1ef206c06adc req-4ce65024-8590-406a-a6c0-f42a6b2cb7f1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032719 Aug 31 19:33:20.867353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 442/879] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:20.884574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:20.893596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a1e31d1-d29b-4e58-b3b3-d90a80d04d03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.208879 Aug 31 19:33:20.894233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 438/880] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:20 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:21.855123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:21.855750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:21.861947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:21.862433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:21.862892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:21.863785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:21.864186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:21.864623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:21.915499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:21.916117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:21.922650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:21.923166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:21.923613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:21.924307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:21.924764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:21.925200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:21.997384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:22.005764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3c790688-5ac9-4ce7-879f-7c437161c798 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1548 microversion: 2.1 time: 0.155563 Aug 31 19:33:22.006332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 443/881] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:21 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:22.031849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:22.032350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:22.038570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:22.039105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:22.039554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:22.040261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:22.040764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:22.041151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:22.070019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:22.077702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2a9cd460-ca4b-4893-af5b-4635c9d76904 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.166014 Aug 31 19:33:22.078278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 439/882] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:21 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:22.084531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:22.085024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:22.091598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:22.092087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:22.092524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:22.093240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:22.093704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:22.094230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:22.119232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a4c6fa4d-fb91-4b17-9431-e175f3b56f2b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091228 Aug 31 19:33:22.119829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 444/883] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:33:22 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:33:22.126598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:33:22.418219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0a4441cb-15ab-49c6-9be0-bdbb7e1d7c86 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 204 len: 0 microversion: 2.1 time: 0.338596 Aug 31 19:33:22.418727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 440/884] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:33:22 2022] DELETE /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:33:22.426832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:22.428394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:22.434991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:22.435483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:22.435918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:22.436693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:22.437162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:22.437594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:22.680230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:22.688446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b16cadb5-527b-4ed5-beab-efdfa1f345e4 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1553 microversion: 2.1 time: 0.265420 Aug 31 19:33:22.689016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 445/885] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:22 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:23.100825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:23.101784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:23.107996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:23.111381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:23.111381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:23.111381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:23.111381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:23.112739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:23.214525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-3fad8a53-5c33-417c-abff-ff22bd33c340 req-5515c94f-236b-48f7-a844-0c8bef1f4f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11a06384-0ef1-449c-a47a-f2fd14d9f33c", "tag": "ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:23.228567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3fad8a53-5c33-417c-abff-ff22bd33c340 req-5515c94f-236b-48f7-a844-0c8bef1f4f53 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:23.229402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3fad8a53-5c33-417c-abff-ff22bd33c340 req-5515c94f-236b-48f7-a844-0c8bef1f4f53 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:23.230050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3fad8a53-5c33-417c-abff-ff22bd33c340 req-5515c94f-236b-48f7-a844-0c8bef1f4f53 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:23.243882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-3fad8a53-5c33-417c-abff-ff22bd33c340 req-5515c94f-236b-48f7-a844-0c8bef1f4f53 service nova] Creating event network-changed:ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1 for instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c on hv-cinder-85220 Aug 31 19:33:23.249722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-3fad8a53-5c33-417c-abff-ff22bd33c340 req-5515c94f-236b-48f7-a844-0c8bef1f4f53 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039018 Aug 31 19:33:23.250432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 446/886] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:23.266784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:23.276117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-141335b4-7849-42f3-916e-d1cdaba7f9ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.180436 Aug 31 19:33:23.276395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 441/887] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:23 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:23.711122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:23.711840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:23.718805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:23.719346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:23.719790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:23.720508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:23.720973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:23.721407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:23.857928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:23.866508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04e06244-6360-4da8-a5f8-8423a4de1aae tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1553 microversion: 2.1 time: 0.160295 Aug 31 19:33:23.867126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 447/888] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:23 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:24.297390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:24.298620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:24.307374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.308147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.308718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.309551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.310123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.310659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.313997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:24.457881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:24.470204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-49ecdf6c-41a3-4383-aa92-4860f2bc550a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1365 microversion: 2.1 time: 0.176477 Aug 31 19:33:24.475286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 442/889] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:24 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:24.888297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:24.888910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:24.896904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.897392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.897827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.898539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:24.899025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:24.899460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:24.902238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:25.029940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:25.037717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4fdbfab2-7876-4d03-82b6-b4c3b2e7f6d9 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1553 microversion: 2.1 time: 0.153376 Aug 31 19:33:25.038282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 448/890] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:24 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:25.492536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:25.493372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:25.500555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:25.501047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:25.501489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:25.502190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:25.502651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:25.503116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:25.638398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:25.647193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6d991987-4f49-4329-a1e3-74b9ee40823e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1555 microversion: 2.1 time: 0.158457 Aug 31 19:33:25.647769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 443/891] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:25 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:25.667915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:25.668414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:25.670287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:33:25.675808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:25.676327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:25.676775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:25.677478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:25.677938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:25.678409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:25.846107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7cca3f32-70d6-461b-8be5-0ce20557e965 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.182109 Aug 31 19:33:25.853836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 449/892] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:33:25 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:26.059560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:26.060288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:26.067152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:26.067898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:26.068343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:26.069052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:26.069808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:26.070415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:26.585322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:26.594370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-12b98424-77e0-4229-a942-1afec9a903dc tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1553 microversion: 2.1 time: 0.539016 Aug 31 19:33:26.609921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 444/893] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:26 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1553 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:26.840463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-feab2db9-07a5-4ed4-a624-21ecabd95b44 req-b98b7f09-16e1-44fe-91b7-7af28327e320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c8506a-53ab-4966-adeb-4325fef54610", "name": "network-vif-deleted", "tag": "86560688-f0cc-412f-aa9d-12bebb775652"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:26.851148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-feab2db9-07a5-4ed4-a624-21ecabd95b44 req-b98b7f09-16e1-44fe-91b7-7af28327e320 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:26.851640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-feab2db9-07a5-4ed4-a624-21ecabd95b44 req-b98b7f09-16e1-44fe-91b7-7af28327e320 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:26.852077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-feab2db9-07a5-4ed4-a624-21ecabd95b44 req-b98b7f09-16e1-44fe-91b7-7af28327e320 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:26.865178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-feab2db9-07a5-4ed4-a624-21ecabd95b44 req-b98b7f09-16e1-44fe-91b7-7af28327e320 service nova] Creating event network-vif-deleted:86560688-f0cc-412f-aa9d-12bebb775652 for instance b2c8506a-53ab-4966-adeb-4325fef54610 on hv-cinder-85220 Aug 31 19:33:26.869271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-feab2db9-07a5-4ed4-a624-21ecabd95b44 req-b98b7f09-16e1-44fe-91b7-7af28327e320 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Aug 31 19:33:26.873723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 450/894] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:27.231222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-1971c820-aaea-4555-a7cc-0751280870a8 req-283a182c-9c2e-4f06-a1d2-b7dc774834fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "952eb54c-5683-4fdf-ad61-7564b9dafbb5", "tag": "347cb772-84b0-4f57-ae0d-400895cb5c95"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:33:27.246962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-1971c820-aaea-4555-a7cc-0751280870a8 req-283a182c-9c2e-4f06-a1d2-b7dc774834fb service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:27.247803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-1971c820-aaea-4555-a7cc-0751280870a8 req-283a182c-9c2e-4f06-a1d2-b7dc774834fb service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:27.248408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-1971c820-aaea-4555-a7cc-0751280870a8 req-283a182c-9c2e-4f06-a1d2-b7dc774834fb service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:27.262225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-1971c820-aaea-4555-a7cc-0751280870a8 req-283a182c-9c2e-4f06-a1d2-b7dc774834fb service nova] Creating event network-changed:347cb772-84b0-4f57-ae0d-400895cb5c95 for instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 on hv-cinder-85220 Aug 31 19:33:27.269717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-1971c820-aaea-4555-a7cc-0751280870a8 req-283a182c-9c2e-4f06-a1d2-b7dc774834fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042612 Aug 31 19:33:27.271235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 445/895] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:33:27.619993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:27.620861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:27.631446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:27.631945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:27.632378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:27.633243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:27.633702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:27.634240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:27.668411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:27.668895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:27.669330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:27.670101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lazy-loading 'fault' on Instance uuid b2c8506a-53ab-4966-adeb-4325fef54610 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:33:27.722584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca526289756647429b819f466da8941f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59a32b67fde4526bbb78d6e0a1cebda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:33:27.733220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5588c7a4-ab29-40ee-8acb-f02bd12bd1de tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 200 len: 1347 microversion: 2.1 time: 0.118452 Aug 31 19:33:27.733802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 451/896] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:27 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 1347 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:33:28.761309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:28.764305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] [instance: b2c8506a-53ab-4966-adeb-4325fef54610] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:33:28.769667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:28.770330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:28.770779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:28.771530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:33:28.771994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:33:28.772481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:33:28.788505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] HTTP exception thrown: Instance b2c8506a-53ab-4966-adeb-4325fef54610 could not be found. Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Request method failure captured: Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 HTTP/1.1 Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7ZnfSb3QdhB8pZudjgUp8ucd3ZScdekE3seZqhdPYtFU1dStRLpJowIHJlOancP4hwj8WGiSj5fSeFWob2J5eo66utdaZdSp8lhxCyi2qArKe_YAsOcUbSp91dBUFiGb2rFshs18UPDVnQ11mTHuvG6UHwN8-Xw0s9iDZVkGCtKJqU Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b59a32b67fde4526bbb78d6e0a1cebda Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-TestMinimumBasicScenario-1432602417 Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:33:28.790057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b59a32b67fde4526bbb78d6e0a1cebda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b59a32b67fde4526bbb78d6e0a1cebda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b59a32b67fde4526bbb78d6e0a1cebda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b59a32b67fde4526bbb78d6e0a1cebda", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-TestMinimumBasicScenario-1432602417 Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b59a32b67fde4526bbb78d6e0a1cebda Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1432602417 Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-TestMinimumBasicScenario-1432602417-project Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: ca526289756647429b819f466da8941f Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-TestMinimumBasicScenario-1432602417-project Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance b2c8506a-53ab-4966-adeb-4325fef54610 could not be found. Aug 31 19:33:28.791744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'b2c8506a-53ab-4966-adeb-4325fef54610'} Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c8506a-53ab-4966-adeb-4325fef54610 could not be found. Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:33:28.792660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c8506a-53ab-4966-adeb-4325fef54610 could not be found. Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c8506a-53ab-4966-adeb-4325fef54610 could not be found. Aug 31 19:33:28.793942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:33:28.795136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Returning 404 to user: Instance b2c8506a-53ab-4966-adeb-4325fef54610 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:33:28.795136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fc62b529-41fc-44f8-ab07-084c3fe7da46 tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610" status: 404 len: 111 microversion: 2.1 time: 0.034640 Aug 31 19:33:28.795136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 446/897] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:33:28 2022] GET /compute/v2.1/servers/b2c8506a-53ab-4966-adeb-4325fef54610 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:33:28.800859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-658e8d2e-8e47-4392-bd12-06c90d481d5f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] Calling method '.version_select at 0x7ff6cb326160>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:33:28.897196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-658e8d2e-8e47-4392-bd12-06c90d481d5f tempest-TestMinimumBasicScenario-1432602417 tempest-TestMinimumBasicScenario-1432602417-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-214267471" status: 202 len: 0 microversion: 2.1 time: 0.100565 Aug 31 19:33:28.897784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 452/898] 10.222.0.59 () {58 vars in 1269 bytes} [Wed Aug 31 19:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-214267471 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:34:07.168078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-518641950", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-667416223", "security_groups": [{"name": "tempest-secgroup-smoke-130140016"}], "block_device_mapping_v2": [{"uuid": "d6e90760-0848-4df1-b098-7e34f289bb4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eef987c2-b70a-4b27-b2c6-0c199324cbe1"}]}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:07.180188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:07.180838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=21 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:07.287612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] validate_networks() for [('eef987c2-b70a-4b27-b2c6-0c199324cbe1', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:34:07.665194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:34:07.665624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:34:07.666103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:34:07.666539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:34:07.667001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:34:07.675906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:07.676397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:07.676838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:07.677581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:07.678041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:07.678473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:07.696400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:34:07.700408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Getting quotas for user be55f0bb21f044b0a8346cf953b1650e and project b8bfa72ff61547e5a3097e5b40483f8a. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:34:07.757880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:34:07.760294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d6e90760-0848-4df1-b098-7e34f289bb4d',volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:34:08.132760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-85a7b4cf-2fdc-4223-af1f-7ec8cad8e2ee tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.968576 Aug 31 19:34:08.133393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 447/899] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:34:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:34:08.142205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=19 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:08.143671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:08.148326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-159a2989-fd42-4387-add6-8a874bc377b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:08.148925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-159a2989-fd42-4387-add6-8a874bc377b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:08.206315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-159a2989-fd42-4387-add6-8a874bc377b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:08.214161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-159a2989-fd42-4387-add6-8a874bc377b0 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1093 microversion: 2.1 time: 0.073628 Aug 31 19:34:08.214676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 453/900] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:08 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:09.235377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:09.235921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:09.242292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:09.242786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:09.243259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:09.243959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:09.244420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:09.244854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:09.306759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:09.314768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5a903d3f-b5bf-4001-977b-5046cff60f47 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1143 microversion: 2.1 time: 0.083846 Aug 31 19:34:09.315367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 448/901] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:09 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:10.337002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:10.337680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:10.344194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:10.344686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:10.345130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:10.345882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:10.346350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:10.347318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:10.444751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:10.452542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a557593c-dd78-4976-806b-1b1bb52ecfda tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1199 microversion: 2.1 time: 0.120336 Aug 31 19:34:10.453349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 454/902] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:10 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:11.476793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:11.477802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:11.485796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:11.486394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:11.486984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:11.492124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:11.492124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:11.492124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:11.642821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:11.651452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9aa5e0ad-e140-4845-a32e-3b24b44cd782 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1276 microversion: 2.1 time: 0.180446 Aug 31 19:34:11.652024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 449/903] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:11 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:12.466061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-c3bfa830-9e1b-4040-9d1f-7cae730f368b req-1e51473b-231e-4481-be80-29c7ce2c533d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664fdd1e-5df7-41ec-93d8-3412f341da30", "tag": "e25476ad-a151-4b68-9a71-999950b01698"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:12.476880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-c3bfa830-9e1b-4040-9d1f-7cae730f368b req-1e51473b-231e-4481-be80-29c7ce2c533d service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:12.477371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-c3bfa830-9e1b-4040-9d1f-7cae730f368b req-1e51473b-231e-4481-be80-29c7ce2c533d service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:12.477811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-c3bfa830-9e1b-4040-9d1f-7cae730f368b req-1e51473b-231e-4481-be80-29c7ce2c533d service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:12.489362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-c3bfa830-9e1b-4040-9d1f-7cae730f368b req-1e51473b-231e-4481-be80-29c7ce2c533d service nova] Creating event network-changed:e25476ad-a151-4b68-9a71-999950b01698 for instance 664fdd1e-5df7-41ec-93d8-3412f341da30 on hv-cinder-85220 Aug 31 19:34:12.494511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-c3bfa830-9e1b-4040-9d1f-7cae730f368b req-1e51473b-231e-4481-be80-29c7ce2c533d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032444 Aug 31 19:34:12.495309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 455/904] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:12.673128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:12.673829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:12.680581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:12.681074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:12.681512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:12.682217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:12.683293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:12.683293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:12.823227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:12.834747 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-957582ea-b0ad-4e8d-bdec-fef7dba0e120 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.165491 Aug 31 19:34:12.843569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 450/905] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:12 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:13.858574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:13.859370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:13.866551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:13.871939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:13.871939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:13.871939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:13.871939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:13.872313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:14.003778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:14.011415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2d7d7470-0ebe-4699-ae5a-f79e0237c74f tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.157320 Aug 31 19:34:14.011971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 456/906] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:13 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:15.031821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:15.032375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:15.038803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:15.039340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:15.039776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:15.040467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:15.040921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:15.041350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:15.170887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:15.179127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0c548a6e-de25-4d63-8f80-fd5bc5d192ac tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.151194 Aug 31 19:34:15.179683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 451/907] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:15 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:16.200837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:16.201472 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:16.209030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:16.209533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:16.209975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:16.210671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:16.211162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:16.211846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:16.343498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:16.352382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-12031e41-4a3b-43e9-9804-164227878718 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.155405 Aug 31 19:34:16.356339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 457/908] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:16 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:17.025946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:17.026444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:17.032851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:17.033337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:17.033778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:17.034473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:17.034959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:17.036048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:17.059371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e271801-697c-4d8b-881e-cba4bcbc8468 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/ips" status: 200 len: 151 microversion: 2.20 time: 0.037363 Aug 31 19:34:17.059936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 452/909] 10.222.0.59 () {60 vars in 1289 bytes} [Wed Aug 31 19:34:17 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:34:17.372706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:17.373326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:17.380740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:17.381720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:17.381720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:17.382370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:17.382991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:17.383325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:17.516183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:17.525258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-788b2716-0b21-4dd4-a2ee-897b804e3333 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.156485 Aug 31 19:34:17.525837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 458/910] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:17 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:18.545607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:18.546166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:18.547984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:18.548637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:18.554837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:18.555506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:18.555944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:18.556629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:18.557082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:18.557507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:18.704113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:18.712873 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-40cce342-8846-4ae6-aa35-c127765a62d1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.171108 Aug 31 19:34:18.713443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 453/911] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:18 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:19.734662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:19.735350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:19.739737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:19.743622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:19.744113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:19.744552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:19.745258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:19.745721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:19.746150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:19.879936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:19.887747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-02746e8f-1173-4ff2-bffb-59aa5d72b166 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.156847 Aug 31 19:34:19.889397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 459/912] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:19 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:20.286014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:20.287181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:20.293722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:20.294215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:20.294658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:20.295431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:20.295889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:20.296319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:20.320282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lazy-loading 'flavor' on Instance uuid 3d3e627d-6271-4e22-a196-daf63472224e {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:34:20.736698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0291689f-ba53-484a-ba0c-ed87eb8ac125 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/action" status: 202 len: 0 microversion: 2.20 time: 0.454733 Aug 31 19:34:20.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 454/913] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 31 19:34:20 2022] POST /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:34:20.746238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:20.746845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:20.753325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:20.753869 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:20.754441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:20.755156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:20.755611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:20.756032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:20.883122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:20.891253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:20.892739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:20.893898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-043b1509-108f-42b5-b292-d4df85382154 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.151531 Aug 31 19:34:20.894963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 460/914] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:20 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:20.909692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:20.911143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:20.917393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:20.917883 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:20.918322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:20.919053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:20.919517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:20.919947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:21.051402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:21.059545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7148252d-1373-418f-96a8-59eaacd1f322 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.154007 Aug 31 19:34:21.060111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 455/915] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:20 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:21.917145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:21.917754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:21.924338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:21.924983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:21.925450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:21.926651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:21.927134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:21.927730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:22.060087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:22.068726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:22.070159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:22.071373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0a0c2e4e-34ec-466c-86f7-e94965470327 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.158064 Aug 31 19:34:22.071943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 461/916] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:21 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:22.080187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:22.080807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:22.088608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:22.089094 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:22.089566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:22.090272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:22.090734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:22.091231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:22.225181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:22.232967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e8482348-272b-4417-a5e0-da1349867e3a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.156605 Aug 31 19:34:22.233531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 456/917] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:22 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:23.095171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:23.095779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:23.102652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:23.103171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:23.103613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:23.104328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:23.104781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:23.105221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:23.232574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:23.241165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:23.242578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:23.243777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0ed83dc4-9318-4c95-bd0e-880eb735cf43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.152571 Aug 31 19:34:23.244335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 462/918] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:23 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:23.253411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:23.254610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:23.261182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:23.261667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:23.262129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:23.262823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:23.263320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:23.263745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:23.394215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:23.402666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e95bdc1b-bc6b-483f-9579-d6c400ace599 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.153050 Aug 31 19:34:23.403288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 457/919] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:23 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:24.266989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:24.267594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:24.274118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:24.274645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:24.275064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:24.275755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:24.276208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:24.276630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:24.412775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:24.420936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:24.422383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:24.423174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:24.423655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-921390fa-f8f4-49a6-8d2d-81ebe7f773ff tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.160485 Aug 31 19:34:24.423764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:24.424118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 463/920] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:24 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:24.430904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:24.431388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:24.431825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:24.432512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:24.432968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:24.433386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:24.565708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:24.573901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-86f868db-b349-443b-827d-217f17479881 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.154453 Aug 31 19:34:24.574677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 458/921] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:24 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:34:25.447450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:25.448056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:25.454418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:25.454997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:25.455467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:25.456158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:25.456612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:25.457032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:25.590374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:25.594336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:25.595079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:25.599066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:25.601032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:25.602327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8616c53c-6fe7-499f-9507-68f9691cdafe tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.158887 Aug 31 19:34:25.602563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:25.603132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 464/922] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:25 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:25.603261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:25.603580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:25.604285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:25.604745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:25.605173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:25.747987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:25.756459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09ebb6e3-2661-46d3-aaa7-73fdaca00fb6 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.165948 Aug 31 19:34:25.757123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 459/923] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:25 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:26.625459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:26.626059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:26.632953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:26.633439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:26.633880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:26.634578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:26.635072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:26.635503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:26.763758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:26.771792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:26.773452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:26.774627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-157fb6bb-5289-4033-a715-394eaa07f775 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.153049 Aug 31 19:34:26.775370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 465/924] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:26 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:26.779088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:26.779787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:26.786717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:26.787348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:26.788862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:26.788862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:26.789681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:26.789681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:26.920168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:26.928063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-30981b2b-bd0f-44f7-b1be-d0ce8abe9597 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.153529 Aug 31 19:34:26.928633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 460/925] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:26 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:34:27.115521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-366ee9f5-954b-4e7a-871c-27a27a3cc451 req-0a945793-a806-4225-a1aa-35aa79b10220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664fdd1e-5df7-41ec-93d8-3412f341da30", "name": "network-vif-plugged", "status": "completed", "tag": "e25476ad-a151-4b68-9a71-999950b01698"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:27.125350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-366ee9f5-954b-4e7a-871c-27a27a3cc451 req-0a945793-a806-4225-a1aa-35aa79b10220 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.125830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-366ee9f5-954b-4e7a-871c-27a27a3cc451 req-0a945793-a806-4225-a1aa-35aa79b10220 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.126269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-366ee9f5-954b-4e7a-871c-27a27a3cc451 req-0a945793-a806-4225-a1aa-35aa79b10220 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:27.137355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-366ee9f5-954b-4e7a-871c-27a27a3cc451 req-0a945793-a806-4225-a1aa-35aa79b10220 service nova] Creating event network-vif-plugged:e25476ad-a151-4b68-9a71-999950b01698 for instance 664fdd1e-5df7-41ec-93d8-3412f341da30 on hv-cinder-85220 Aug 31 19:34:27.142695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-366ee9f5-954b-4e7a-871c-27a27a3cc451 req-0a945793-a806-4225-a1aa-35aa79b10220 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031427 Aug 31 19:34:27.143561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 466/926] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:27.797744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:27.798352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:27.805502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.805985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.806422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:27.807142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.807601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.808028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:27.939604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:27.947939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:27.949359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:27.949830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:27.950054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:27.950687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b3192d75-ef90-46d9-b792-4e7cc4dc4367 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.157027 Aug 31 19:34:27.953257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 461/927] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:27 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:27.956760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.957241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.957676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:27.958372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:27.958826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:27.959307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:28.092925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:28.101341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6df71f80-f49f-4bde-ad80-0bd17aa09fff tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.156126 Aug 31 19:34:28.101916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 467/928] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:27 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:34:28.976500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:28.977044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:28.983937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:28.984426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:28.984871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:28.985578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:28.986039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:28.986472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:29.004417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:29.118757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:29.121688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:29.125757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:29.127044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:29.128484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:29.128622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:29.129101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:29.129541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:29.129662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-61de262d-85b8-4355-81a7-6772ee6d461e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.157883 Aug 31 19:34:29.130831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 462/929] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:28 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:29.130983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:29.131374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:29.131807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:29.274403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:29.287742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-30acb0a0-dbb7-49e1-bb7e-e02b8ae717f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.169706 Aug 31 19:34:29.288328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 468/930] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:29 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:34:30.153618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:30.154227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:30.162033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:30.162669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:30.163140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:30.163842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:30.164328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:30.164772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:30.304074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:30.312312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:30.312835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:30.314651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:30.314782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:30.315301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b33eaf68-9d6c-48df-8ef2-5f1dbfcaa4e0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.165531 Aug 31 19:34:30.315857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 463/931] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:30 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:30.323435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:30.323924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:30.324366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:30.325321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:30.325926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:30.326363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:30.466484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:30.474469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b6889a78-59eb-426f-ba28-08d51526ad7a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1264 microversion: 2.1 time: 0.167404 Aug 31 19:34:30.477268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 469/932] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:30 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:34:31.338734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:31.339402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:31.346105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:31.346580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:31.347052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:31.347742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:31.348199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:31.348628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:31.483479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:31.491785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:31.493250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:31.494410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-84a02c6e-247c-4728-be77-e9ac878e06e8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.159965 Aug 31 19:34:31.494898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:31.495430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 464/933] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:31 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:31.495536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:31.501870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:31.502350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:31.502790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:31.503505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:31.503959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:31.504381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:31.640383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:31.648779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e6a3d238-832e-4ef4-b588-192e7eebf82c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1451 microversion: 2.1 time: 0.157638 Aug 31 19:34:31.649345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 470/934] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:31 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:34:31.669779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:31.670398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:31.676288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:31.676786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:31.677253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:31.677952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:31.678412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:31.678929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:31.809109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:31.816729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-be1e13ab-1091-4d12-b03d-f841833e23f1 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1451 microversion: 2.1 time: 0.150740 Aug 31 19:34:31.817351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 465/935] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:34:31 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:34:32.518551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:32.519185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:32.525808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:32.526286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:32.526762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:32.527575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:32.528029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:32.528454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:33.035233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:33.039687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:33.044801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:33.046296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:33.047547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c08b138a-1dd2-4e3a-827a-9e09155a1557 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.532934 Aug 31 19:34:33.048110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 471/936] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:32 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:34.071241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:34.071852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:34.077768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:34.078253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:34.078690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:34.079455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:34.079915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:34.080343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:34.220174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:34.229799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:34.231380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:34.232586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d25f6420-b947-487b-b28f-72ca7c79e6a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.165554 Aug 31 19:34:34.233143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 466/937] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:34 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:34.285882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-520d320e-eaa7-4126-b493-acf672dc8599 req-3580a1f0-2485-428e-8bc2-dcffae8661fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664fdd1e-5df7-41ec-93d8-3412f341da30", "tag": "e25476ad-a151-4b68-9a71-999950b01698"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:34.297855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-520d320e-eaa7-4126-b493-acf672dc8599 req-3580a1f0-2485-428e-8bc2-dcffae8661fe service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:34.298699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-520d320e-eaa7-4126-b493-acf672dc8599 req-3580a1f0-2485-428e-8bc2-dcffae8661fe service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:34.299227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-520d320e-eaa7-4126-b493-acf672dc8599 req-3580a1f0-2485-428e-8bc2-dcffae8661fe service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:34.310253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-520d320e-eaa7-4126-b493-acf672dc8599 req-3580a1f0-2485-428e-8bc2-dcffae8661fe service nova] Creating event network-changed:e25476ad-a151-4b68-9a71-999950b01698 for instance 664fdd1e-5df7-41ec-93d8-3412f341da30 on hv-cinder-85220 Aug 31 19:34:34.316323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-520d320e-eaa7-4126-b493-acf672dc8599 req-3580a1f0-2485-428e-8bc2-dcffae8661fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034383 Aug 31 19:34:34.316915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 472/938] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:35.257345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:35.257926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:35.264597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:35.265088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:35.265569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:35.266335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:35.266801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:35.267268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:35.400203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:35.408737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:35.413532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:35.413532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-21e2bfa3-c793-48fa-ab63-0dfd1c955d00 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.158501 Aug 31 19:34:35.413532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 467/939] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:35 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:36.437462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:36.438150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:36.444766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:36.445239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:36.445673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:36.446359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:36.446811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:36.447265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:36.575978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:36.584309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:36.585768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:36.587233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-44681433-867e-4ea7-a0ec-329af029bee5 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.154596 Aug 31 19:34:36.587800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 473/940] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:36 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:37.609741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:37.610385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:37.612737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:37.617739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:37.618229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:37.618671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:37.619414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:37.619904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:37.620334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:37.756248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:37.764436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:37.765861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:37.767035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6a94beef-5dd1-4094-b594-6122ba622b56 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.161235 Aug 31 19:34:37.767590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 468/941] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:37 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:38.791236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:38.791861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:38.798282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:38.798780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:38.799259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:38.799965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:38.800431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:38.800865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:38.934142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:38.942581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:38.944183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:38.945340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-706d2f85-3b62-487a-b3f2-de6c4d690a34 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.158717 Aug 31 19:34:38.945892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 474/942] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:38 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:39.174464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-e9b7b0e4-e66e-4b12-adb0-b66f50fb6065 req-64cc5542-4582-4aa0-a673-707f2890a7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "name": "network-vif-plugged", "status": "completed", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:39.184516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-e9b7b0e4-e66e-4b12-adb0-b66f50fb6065 req-64cc5542-4582-4aa0-a673-707f2890a7e7 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:39.184996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-e9b7b0e4-e66e-4b12-adb0-b66f50fb6065 req-64cc5542-4582-4aa0-a673-707f2890a7e7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:39.185431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-e9b7b0e4-e66e-4b12-adb0-b66f50fb6065 req-64cc5542-4582-4aa0-a673-707f2890a7e7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:39.196694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-e9b7b0e4-e66e-4b12-adb0-b66f50fb6065 req-64cc5542-4582-4aa0-a673-707f2890a7e7 service nova] Creating event network-vif-plugged:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:34:39.201637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-e9b7b0e4-e66e-4b12-adb0-b66f50fb6065 req-64cc5542-4582-4aa0-a673-707f2890a7e7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030800 Aug 31 19:34:39.202212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 469/943] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:39.968824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:39.969442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:39.976449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:39.976929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:39.977368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:39.978065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:39.978524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:39.978988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:40.109095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:40.118207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:40.119691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:40.120868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-50ac87ba-91e7-4508-b103-e3c0f19328b0 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.155999 Aug 31 19:34:40.121433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 475/944] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:39 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:41.144785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:41.145491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:41.152415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:41.152904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:41.153351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:41.154047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:41.154506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:41.154963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:41.284481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:41.292899 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:41.294369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:41.295563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b3eec136-9b2a-4a46-a0a3-1ff692b88197 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.155514 Aug 31 19:34:41.296160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 470/945] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:41 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:34:42.319498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:42.320135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:42.322702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=49 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:34:42.327378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:42.327862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:42.328316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:42.329004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:42.329455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:42.329885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:42.460879 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:42.468851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:42.470335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:42.471514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-184a3298-db73-4bed-b808-e3a831cfb83d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1744 microversion: 2.20 time: 0.156268 Aug 31 19:34:42.472071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 476/946] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:42 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:43.495614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:43.496165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:43.502898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:43.503621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:43.504238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:43.504948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:43.506088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:43.506703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:43.651277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:43.660204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:43.662218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:43.663584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fd9d1347-d59b-4579-abf0-6fa25921b1ea tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.171983 Aug 31 19:34:43.664153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 471/947] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:43 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:44.689580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:44.690397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:44.699779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:44.700737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:44.701694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:44.702733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:44.703746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:44.704390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:44.848452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:44.858549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:44.860247 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:44.861425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2cd706e5-7e1e-48cc-be36-3c5c55aa4884 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.176586 Aug 31 19:34:44.862154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 477/948] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:44 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:45.888930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:45.889481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:45.896315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:45.897210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:45.897876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:45.899110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:45.899852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:45.900510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:46.066002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:46.076025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:46.077479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:46.078708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-af3f10a4-6166-4a57-b45e-c74ecca9e603 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.195569 Aug 31 19:34:46.079649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 472/949] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:45 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:47.110409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:47.111153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:47.119459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:47.119957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:47.120406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:47.121120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:47.121586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:47.122022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:47.289502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:47.301888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:47.305031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:47.306996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c891384e-68f8-4782-967b-eddf4400f5c6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.204236 Aug 31 19:34:47.308098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 478/950] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:47 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:48.338003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:48.338601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:48.345412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:48.346079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:48.346524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:48.347259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:48.347720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:48.348150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:48.494802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:48.503611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:48.505573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:48.507236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-02a9b944-5631-434d-89e5-ee175871b8df tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.174626 Aug 31 19:34:48.507881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 473/951] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:48 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:49.534986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:49.535545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:49.543074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.543804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.544457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.545361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:49.546003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:49.546627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:49.690835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:49.699512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:49.700933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:49.702131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c4069380-9467-4eb9-9b6c-6d4d9fc8463b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.172621 Aug 31 19:34:49.702685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 479/952] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:49 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:50.728588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:50.729201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:50.735702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:50.736188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:50.736620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:50.737307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:50.737764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:50.738190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:50.880771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:50.889420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:50.890853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:50.892037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-199625cd-715e-4eed-adb9-22745cf5c293 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.167328 Aug 31 19:34:50.892598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 474/953] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:50 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:51.917014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:51.917631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:51.924090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:51.924874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:51.925504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:51.926135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:51.928142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:51.928142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:52.090850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:52.099709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:52.101154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:52.102331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-23470aaf-ad61-430a-b6aa-c769d59c7e7a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.189899 Aug 31 19:34:52.108290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 480/954] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:51 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:53.126090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:53.127258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:53.139594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:53.158590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:53.158590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:53.158590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:53.158590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:53.160298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:53.309024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:53.321029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:53.323068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:53.324266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-84de5d82-bc2d-47a7-8f87-1cf16a2ec3a3 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.202402 Aug 31 19:34:53.324828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 475/955] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:53 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:54.347585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:54.348225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:54.355383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:54.355878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:54.356380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:54.357097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:54.357551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:54.357980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:54.496966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:54.506110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:54.507610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:54.508783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-36ae96e4-0981-4c4e-a7a2-df430e4ad460 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.165179 Aug 31 19:34:54.511332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 481/956] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:54 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:55.531468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:55.532685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:55.539274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:55.539760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:55.540194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:55.540916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:55.541526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:55.541959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:55.673036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:55.681874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:55.683358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:55.684513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8d8739c4-c70d-4b1b-979e-dd8abac01c05 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1739 microversion: 2.20 time: 0.157120 Aug 31 19:34:55.685063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 476/957] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:55 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:56.707946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:56.709112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:56.715877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:56.716368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:56.716811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:56.717523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:56.717987 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:56.718420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:56.919871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:56.928479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:56.930001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:56.931215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3e91a1fc-c958-4d58-bfb7-f71ebfcf626e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1721 microversion: 2.20 time: 0.227278 Aug 31 19:34:56.931781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 482/958] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:56 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:34:57.954733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:57.955372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:57.962203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:57.962680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:57.963137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:57.963824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:57.964276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:57.964700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:58.205768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:58.214347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:58.215826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:58.216983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e066e772-2ec5-4ac5-8a27-3609933a0b98 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1721 microversion: 2.20 time: 0.266169 Aug 31 19:34:58.217546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 477/959] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:57 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:34:59.240420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:34:59.241047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:34:59.247710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:59.248204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:59.248652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:59.249396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:59.249861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:59.250297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:59.292933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-0d4c632d-80b7-43d2-b705-a5ae77272b5a req-6fb30574-d749-491c-bdd9-2192eacacc54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "name": "network-vif-unplugged", "status": "completed", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:34:59.303029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-0d4c632d-80b7-43d2-b705-a5ae77272b5a req-6fb30574-d749-491c-bdd9-2192eacacc54 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:34:59.305352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-0d4c632d-80b7-43d2-b705-a5ae77272b5a req-6fb30574-d749-491c-bdd9-2192eacacc54 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:34:59.305352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-0d4c632d-80b7-43d2-b705-a5ae77272b5a req-6fb30574-d749-491c-bdd9-2192eacacc54 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:34:59.314983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-0d4c632d-80b7-43d2-b705-a5ae77272b5a req-6fb30574-d749-491c-bdd9-2192eacacc54 service nova] Creating event network-vif-unplugged:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:34:59.320890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-0d4c632d-80b7-43d2-b705-a5ae77272b5a req-6fb30574-d749-491c-bdd9-2192eacacc54 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031945 Aug 31 19:34:59.321790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 478/960] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:34:59.444274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:59.455257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:59.457598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:34:59.458585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d685cf0d-2a35-4e38-aa6c-69c1544f9b81 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1721 microversion: 2.20 time: 0.221525 Aug 31 19:34:59.459358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 483/961] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:34:59 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:00.482610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:00.483247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:00.490185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:00.490699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:00.491169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:00.491863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:00.492313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:00.492739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:00.496779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=91 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:00.674462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:00.674462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:00.674730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:00.674730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-af2934f7-75c3-4b32-9e02-381c682e0e64 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1664 microversion: 2.20 time: 0.165170 Aug 31 19:35:00.674730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 479/962] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:00 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:00.675064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8413762c-5128-4b60-b2dd-128ddba76d4b"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:00.675064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:00.675064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:00.675064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:00.675786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:00.676086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:00.677231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:00.677590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:01.654796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b745d4d9-6d12-42fb-b5f2-58617cfe5a38 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.992982 Aug 31 19:35:01.655382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 484/963] 10.222.0.59 () {62 vars in 1364 bytes} [Wed Aug 31 19:35:00 2022] POST /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-volume_attachments => generated 188 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:35:01.782486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:01.783029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:01.790388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:01.790893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:01.791342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:01.792040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:01.792499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:01.792927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:02.408334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b5414c8b-4c19-4b2a-8e9c-1a78c2f3cced tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-volume_attachments/8413762c-5128-4b60-b2dd-128ddba76d4b" status: 202 len: 0 microversion: 2.20 time: 0.629691 Aug 31 19:35:02.408931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 480/964] 10.222.0.59 () {60 vars in 1457 bytes} [Wed Aug 31 19:35:01 2022] DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-volume_attachments/8413762c-5128-4b60-b2dd-128ddba76d4b => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:35:02.469042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:02.469646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:02.476937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:02.477430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:02.477875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:02.478583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:02.479123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:02.479559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:02.524063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121187) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 19:35:02.645644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:02.841175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-561581cf-5cfe-4391-9226-55697cdbf7eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "POST /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/action" status: 202 len: 0 microversion: 2.20 time: 0.376230 Aug 31 19:35:02.842079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 485/965] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 31 19:35:02 2022] POST /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:35:02.850813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:02.851574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:02.858486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:02.858632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:02.859000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:02.859721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:02.860181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:02.860612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:02.995381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:03.003844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:03.005616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:03.007202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ce9e5720-5b0e-4bcf-9535-d3934dec36b4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1672 microversion: 2.20 time: 0.160880 Aug 31 19:35:03.007759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 481/966] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:02 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:35:04.031471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:04.032123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:04.038566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:04.039089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:04.039528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:04.040229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:04.040682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:04.041167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:04.172885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:04.181047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:04.182517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:04.183714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b3f4e4d1-d013-44f6-8976-940d1a87a853 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1674 microversion: 2.20 time: 0.156977 Aug 31 19:35:04.190366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 486/967] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:04 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:35:05.206902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:05.208676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:05.215687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:05.216083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:05.216526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:05.217233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:05.217691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:05.218121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:05.351709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:05.359722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:05.361161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:05.362349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f99872ff-4ed6-4c3c-b057-e9b5af81207b tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.159687 Aug 31 19:35:05.362937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 482/968] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:05 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:06.386038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:06.386696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:06.398227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:06.398715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:06.399182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:06.399883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:06.400338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:06.400763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:06.552212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:06.561040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:06.562575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:06.563701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9d554700-efe7-48e3-a107-95a78c23f381 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.181598 Aug 31 19:35:06.574079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 487/969] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:06 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:07.589217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:07.589896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:07.596392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:07.596876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:07.597317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:07.598968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:07.599446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:07.599876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:07.743393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:07.752041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:07.753571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:07.755215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-52e0c9cb-16ac-45ee-96bc-beaa2de4934c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.170044 Aug 31 19:35:07.755826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 483/970] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:07 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:08.778458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:08.779102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:08.785559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:08.786055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:08.786501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:08.787337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:08.787809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:08.788242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:08.924569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:08.933232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:08.934646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:08.935822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ed3809b7-3ff6-4464-80df-83a5d5a3039f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.161409 Aug 31 19:35:08.936372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 488/971] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:08 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:09.959530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:09.960482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:09.962951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=32 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:09.967753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:09.968241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:09.968683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:09.969383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:09.969842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:09.970300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:10.110884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:10.121206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:10.122654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:10.123905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ced78652-7cbc-43eb-b74f-0c7ba3cef0b7 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.168461 Aug 31 19:35:10.130919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 484/972] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:09 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:11.145971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:11.146623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:11.154354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:11.154895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:11.155338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:11.156268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:11.156707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:11.157144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:11.312327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:11.322532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:11.324156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:11.325346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5aaa4c93-946b-43bb-ac11-4c662c7e6f5f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.183429 Aug 31 19:35:11.325902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 489/973] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:11 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:12.496217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:12.496831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:12.502998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:12.503492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:12.503958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:12.505161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:12.506355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:12.506800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:12.662303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:12.670781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:12.672299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:12.673597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9afc630a-acbe-4a0d-b412-4187edf647d8 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.327820 Aug 31 19:35:12.674260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 485/974] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:12 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:13.699401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:13.700538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:13.702861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:13.708339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:13.708834 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:13.709327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:13.710293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:13.711012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:13.711441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:13.859965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:13.870021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:13.871401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:13.872588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-55a0cb32-1719-4532-afbc-38a9f0326c9c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.179666 Aug 31 19:35:13.873397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 490/975] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:13 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:35:14.896303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:14.896890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:14.903603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:14.904085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:14.904570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:14.905275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:14.905796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:14.906268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:15.049378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:15.059870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:15.061339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:15.062697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4f0b0586-d24e-43b6-8d33-f5bbd11fbc43 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.170873 Aug 31 19:35:15.063735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 486/976] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:14 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:16.089595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:16.090387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:16.096637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:16.097125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:16.097566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:16.098393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:16.098862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:16.099361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:16.242040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:16.250493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:16.251978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:16.257694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3fcdd516-263b-4848-b7ea-9c898e91d963 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.169883 Aug 31 19:35:16.257694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 491/977] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:16 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:17.281143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:17.281785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:17.289049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:17.289822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:17.290258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:17.291004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:17.291457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:17.291878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:17.448144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:17.456239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:17.457662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:17.458863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5c1653f4-d322-4c68-a9f5-76e02cae18f1 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.181679 Aug 31 19:35:17.459441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 487/978] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:17 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:18.483132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:18.483748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:18.490388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:18.490892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:18.491345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:18.492200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:18.492672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:18.493101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:18.627101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:18.639960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:18.641941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:18.643480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-74ade8f1-ce13-44d4-a9a9-655e36ab3b3c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.164333 Aug 31 19:35:18.644232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 492/979] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:18 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:19.667734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:19.668344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:19.675102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:19.675598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:19.676047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:19.676764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:19.677232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:19.677660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:19.824960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:19.833239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:19.834994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:19.836509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5197d6b2-4e21-48b9-a049-a789d2d1a5e4 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.172716 Aug 31 19:35:19.837066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 488/980] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:19 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:20.860023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:20.860628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:20.867042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:20.867524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:20.867958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:20.868644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:20.869098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:20.869519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:20.997394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:21.005404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:21.007218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:21.008443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8d2eca86-5600-4f73-9eb7-c880952412eb tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.152315 Aug 31 19:35:21.009002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 493/981] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:20 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:22.029825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:22.030429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:22.031326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:22.031922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:22.037159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:22.037702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:22.038289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:22.039100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:22.039223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:22.039597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:22.039715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:22.040043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:22.040159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:22.040792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:22.041265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:22.041699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:22.063794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d9290391-be90-4434-9caf-23e44713ca63 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/ips" status: 200 len: 146 microversion: 2.1 time: 0.037963 Aug 31 19:35:22.064634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 489/982] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:35:22 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:22.181250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:22.189421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:22.190982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:22.192137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-938d3418-29f1-45e3-8652-4cb576a799a9 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.165003 Aug 31 19:35:22.193023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 494/983] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:22 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:23.215759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:23.216445 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:23.222967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:23.223455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:23.223898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:23.224596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:23.225056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:23.227529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:23.359498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:23.367853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:23.396872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:23.396872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fb990c94-be3f-4bc2-8d34-f909bb3e923f tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.158570 Aug 31 19:35:23.396872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 490/984] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:23 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:24.393730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:24.394351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:24.402791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:24.403309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:24.404209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:24.404477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:24.404941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:24.405374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:24.537218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:24.545595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:24.547167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:24.548375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3221d08a-5169-4c68-9eef-721563bca093 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.158926 Aug 31 19:35:24.548936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 495/985] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:24 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:24.698093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f8b204d-4489-4f10-a2c2-daa7e857feaa"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:24.700613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:24.707065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:24.707548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:24.707986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:24.708683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:24.709199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:24.709956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:25.572492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:25.573124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:25.580385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:25.580884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:25.581332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:25.582045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:25.582578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:25.583050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:25.798345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:25.807165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:25.808614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:25.809886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d9602de8-2c84-4fa8-b869-2f0c7fc11d88 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.242355 Aug 31 19:35:25.810460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 496/986] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:25 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:35:26.195553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5b092cbf-12a0-4d58-a382-d869df062d12 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.502053 Aug 31 19:35:26.199359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 491/987] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:35:24 2022] POST /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments => generated 194 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:26.291138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:26.291652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:26.297684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:26.298177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:26.298667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:26.299401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:26.299877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:26.300312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:26.325198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b795ece9-c0e3-40a5-bf9d-482470c0e8c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/ips" status: 200 len: 149 microversion: 2.1 time: 0.039536 Aug 31 19:35:26.325843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 497/988] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:35:26 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:26.833565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:26.834292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:26.841350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:26.841838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:26.842281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:26.843016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:26.843474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:26.843904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:26.848131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:27.017077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:27.025888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:27.027358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:27.028521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0ed961f2-201b-4ea9-9348-09a7ee74108c tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.199704 Aug 31 19:35:27.032563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 492/989] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:26 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:35:28.051663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:28.052277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:28.059552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:28.060044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:28.060481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:28.061184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:28.061642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:28.062073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:28.466079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:28.474246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:28.476559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:28.477738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e1897216-6684-40e1-a575-b5d00bb02f59 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.430003 Aug 31 19:35:28.478299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 498/990] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:28 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:29.119806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62679355-12d0-450d-80c2-480b6ee72e62"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:29.122358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:29.129279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:29.129769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:29.130221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:29.130990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:29.132062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:29.132493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:29.507057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:29.507951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:29.515164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:29.515682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:29.516331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:29.517418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:29.518219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:29.519875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:29.661854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:29.673160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:29.674658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:29.675865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5dc37476-1b1a-4bf4-aa61-b34054013dee tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.174875 Aug 31 19:35:29.686896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 499/991] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:29 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 19:35:29.686896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-b098c2da-0dde-4e45-a175-feda6eb0f0db req-4e95fe2b-d6bd-4bff-a3c8-d0d55dc30fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "name": "network-vif-plugged", "status": "completed", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:29.695137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b098c2da-0dde-4e45-a175-feda6eb0f0db req-4e95fe2b-d6bd-4bff-a3c8-d0d55dc30fa3 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:29.696083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b098c2da-0dde-4e45-a175-feda6eb0f0db req-4e95fe2b-d6bd-4bff-a3c8-d0d55dc30fa3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:29.696083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b098c2da-0dde-4e45-a175-feda6eb0f0db req-4e95fe2b-d6bd-4bff-a3c8-d0d55dc30fa3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:29.709966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-b098c2da-0dde-4e45-a175-feda6eb0f0db req-4e95fe2b-d6bd-4bff-a3c8-d0d55dc30fa3 service nova] Creating event network-vif-plugged:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:35:29.717436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-b098c2da-0dde-4e45-a175-feda6eb0f0db req-4e95fe2b-d6bd-4bff-a3c8-d0d55dc30fa3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039442 Aug 31 19:35:29.718052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 500/992] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:29.962024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-41205d62-4a4a-41f1-bc77-5cfc4bb92d5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846233 Aug 31 19:35:29.962645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 493/993] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:35:29 2022] POST /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:30.705597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:30.706245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:30.714513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:30.715127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:30.715615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:30.716461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:30.716984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:30.717456 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:30.850615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:30.859530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:30.861262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:30.862503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-21179734-b1c8-47a4-8866-9c020866b656 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.161753 Aug 31 19:35:30.863373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 501/994] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:30 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:31.890440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:31.891169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:31.898537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:31.899053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:31.899499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:31.900201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:31.900687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:31.901116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:32.040890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:32.049498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:32.050958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:32.052123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3553378c-73bf-4826-8d9a-85dd777df199 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.167061 Aug 31 19:35:32.052674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 494/995] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:31 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:33.076274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:33.076892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:33.083145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:33.083627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:33.084644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:33.085330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:33.085936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:33.086363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:33.231824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:33.241500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:33.243035 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:33.244262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0747b003-861a-40f8-ae9f-96bebd08833a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.172475 Aug 31 19:35:33.244827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 502/996] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:33 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:34.267448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:34.268060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:34.276438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:34.276438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:34.276861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:34.277578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:34.278035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:34.278468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:34.420371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:34.428588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:34.436490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:34.440610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-59578ebf-6b09-4e4b-8cf4-2f7f6dfd74db tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1730 microversion: 2.20 time: 0.174124 Aug 31 19:35:34.440610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 495/997] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:34 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:35.461810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:35.462451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:35.468778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:35.469258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:35.469694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:35.470504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:35.470968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:35.471394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:35.474093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:35.611762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:35.618777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:35.620241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:35.621423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6be3ef55-75ed-4cea-bd21-021cb7bfcb42 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1717 microversion: 2.20 time: 0.164137 Aug 31 19:35:35.621976 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 503/998] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:35:35 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:35:35.873231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:35.875512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:35.882053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:35.882531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:35.883002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:35.883692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:35.884146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:35.884572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:35.914634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2a6efac9-029f-414f-a881-7ac0034ca57c tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045216 Aug 31 19:35:35.915217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 496/999] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:35:35 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:35.936007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:35.936512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:35.942988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:35.943487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:35.943953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:35.944623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:35.945088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:35.945546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:35.975905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dd55c621-86a6-46c1-bb2c-c844c5b68310 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3f8b204d-4489-4f10-a2c2-daa7e857feaa" status: 200 len: 194 microversion: 2.1 time: 0.043901 Aug 31 19:35:35.976480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 504/1000] 10.222.0.59 () {58 vars in 1413 bytes} [Wed Aug 31 19:35:35 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3f8b204d-4489-4f10-a2c2-daa7e857feaa => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:38.842588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3837af0d-9964-45c3-bee5-cd51fdd847f1"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:38.844966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:38.851573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:38.852113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:38.852470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:38.853181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:38.853617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:38.854037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:39.612633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-197f44af-e891-4920-bb77-408fdb365af6 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "POST /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773731 Aug 31 19:35:39.613242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 497/1001] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:35:38 2022] POST /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:35:44.033032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e66f7aba-e557-4e14-bdde-35e2f5a61926 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: .version_select at 0x7ff6cb31cee0>, body: {"keypair": {"name": "tempest-keypair-322373819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1PvyT56Xb11IFB+hArX206wB1VQerfX6QB9tpZ8qaculmHeaWCMZWMMmpleng0QQiyD4BS/asZ1mM839LoIAcMuyCOxvxx13pmLgSrS+tEDD+P8bl+UGonjCmz0eNJGg=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:44.049864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-e66f7aba-e557-4e14-bdde-35e2f5a61926 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:35:44.054046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-e66f7aba-e557-4e14-bdde-35e2f5a61926 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:35:44.174291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e66f7aba-e557-4e14-bdde-35e2f5a61926 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145230 Aug 31 19:35:44.174865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 505/1002] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:35:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:46.814861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1446003130", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e"}], "security_groups": [{"name": "tempest-securitygroup--1150070026"}], "key_name": "tempest-keypair-322373819", "user_data": "}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:46.823224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=28 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:46.922413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] validate_networks() for [('acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:35:47.185536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:35:47.185788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:35:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Aug 31 19:35:47.312588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:35:47.313158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:35:47.313628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:35:47.314104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:35:47.314748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:35:47.326008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:47.326573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:47.327171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:47.327950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:47.328502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:47.328935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:47.350107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:35:47.354238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:35:47.366164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:35:47.368923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:35:47.599996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d90fcd27-9ee6-4741-9ebf-6ceac2b076a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.790406 Aug 31 19:35:47.600638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 498/1003] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:35:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:35:47.609789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=11 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:47.614932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c2d67218-800d-47ca-a53a-14ce85b07b63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:47.627783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c2d67218-800d-47ca-a53a-14ce85b07b63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:47.627783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:47.671932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c2d67218-800d-47ca-a53a-14ce85b07b63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:47.680303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c2d67218-800d-47ca-a53a-14ce85b07b63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1241 microversion: 2.1 time: 0.071163 Aug 31 19:35:47.680879 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 506/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:47 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:48.702318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0bbbefbb-bbb5-44fe-94f6-bd0090c7a7d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:48.702939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0bbbefbb-bbb5-44fe-94f6-bd0090c7a7d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:48.756156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0bbbefbb-bbb5-44fe-94f6-bd0090c7a7d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:48.763989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0bbbefbb-bbb5-44fe-94f6-bd0090c7a7d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1241 microversion: 2.1 time: 0.066016 Aug 31 19:35:48.764652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 499/1005] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:48 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:49.784879 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:49.785557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:49.794361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:49.794851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:49.795316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:49.796032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:49.796493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:49.796927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:49.858581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:49.866675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-94653515-1ea0-43f9-84b0-ea9bfb87455d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1237 microversion: 2.1 time: 0.085728 Aug 31 19:35:49.867337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 507/1006] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:49 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:50.888317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:50.888932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:50.898146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:50.898819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:50.899335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:50.900039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:50.900502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:50.900935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:50.963761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:50.971353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a416b77f-a33e-46f4-b023-693fe9350255 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1293 microversion: 2.1 time: 0.086894 Aug 31 19:35:50.972070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 500/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:50 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:51.993587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:51.994294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:52.000919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.001413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.001932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.002639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.003124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.003551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.113477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:52.121645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2b522711-f7ac-4eaf-b6a2-da67f643bd8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1311 microversion: 2.1 time: 0.133206 Aug 31 19:35:52.122320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 508/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:51 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1311 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:52.468481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:52.470717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:52.477896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.496636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.496636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.496636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.496636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.497048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.512038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a7241dc5-0a8c-4e92-8df0-ba7c5812b127 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047708 Aug 31 19:35:52.512608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 501/1009] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:35:52 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:52.651522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:52.652021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:52.658257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.658750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.659256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.659972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.660437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.660868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.691993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e12835ea-0021-4994-b3ce-7988bf7db775 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3f8b204d-4489-4f10-a2c2-daa7e857feaa" status: 200 len: 194 microversion: 2.1 time: 0.044869 Aug 31 19:35:52.698661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 509/1010] 10.222.0.59 () {58 vars in 1413 bytes} [Wed Aug 31 19:35:52 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3f8b204d-4489-4f10-a2c2-daa7e857feaa => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:52.708612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:52.708612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:52.716905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.717673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.718290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.719112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:52.719585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:52.720374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:52.811320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lazy-loading 'services' on Instance uuid 11a06384-0ef1-449c-a47a-f2fd14d9f33c {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:35:53.105380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5de76845-4d63-4286-a20d-5ceafaf9b1ae tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3f8b204d-4489-4f10-a2c2-daa7e857feaa" status: 202 len: 0 microversion: 2.1 time: 0.404737 Aug 31 19:35:53.106163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 502/1011] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:35:52 2022] DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3f8b204d-4489-4f10-a2c2-daa7e857feaa => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:35:53.143175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:53.144726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:53.152440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:53.152943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:53.153389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:53.154156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:53.154616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:53.155092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:53.365940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:53.374197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e4049a29-1c39-49d3-89e4-3a6fcffad63d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.235046 Aug 31 19:35:53.374862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 510/1012] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:53 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:53.776211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-96e17399-3a15-4f0e-b78a-90cd1b34589b req-5c7a01aa-9e07-4f37-b47c-7456b1e09887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e12e83c-b998-423b-a10f-ca1d120457c5", "tag": "f06043a7-09af-4461-adf6-f90f75c82f7d"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:35:53.786095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-96e17399-3a15-4f0e-b78a-90cd1b34589b req-5c7a01aa-9e07-4f37-b47c-7456b1e09887 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:53.786568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-96e17399-3a15-4f0e-b78a-90cd1b34589b req-5c7a01aa-9e07-4f37-b47c-7456b1e09887 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:53.787022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-96e17399-3a15-4f0e-b78a-90cd1b34589b req-5c7a01aa-9e07-4f37-b47c-7456b1e09887 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:53.797785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-96e17399-3a15-4f0e-b78a-90cd1b34589b req-5c7a01aa-9e07-4f37-b47c-7456b1e09887 service nova] Creating event network-changed:f06043a7-09af-4461-adf6-f90f75c82f7d for instance 9e12e83c-b998-423b-a10f-ca1d120457c5 on hv-cinder-85220 Aug 31 19:35:53.802541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-96e17399-3a15-4f0e-b78a-90cd1b34589b req-5c7a01aa-9e07-4f37-b47c-7456b1e09887 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031217 Aug 31 19:35:53.803386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 503/1013] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:54.395804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:54.396450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:54.403255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:54.403963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:54.404408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:54.405121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:54.405578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:54.406008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:54.580878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:54.590568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6af1dfca-5150-4b8b-80aa-8bd2db6a5389 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.198715 Aug 31 19:35:54.591184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 511/1014] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:54 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:55.298046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:55.298674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:55.305817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:55.306307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:55.306752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:55.307481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:55.307942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:55.308397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:55.339217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f57350b9-e402-4b49-8422-2f38561ad944 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3837af0d-9964-45c3-bee5-cd51fdd847f1" status: 200 len: 194 microversion: 2.1 time: 0.045865 Aug 31 19:35:55.339927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 504/1015] 10.222.0.59 () {58 vars in 1413 bytes} [Wed Aug 31 19:35:55 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3837af0d-9964-45c3-bee5-cd51fdd847f1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:35:55.350394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:55.350936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:55.357226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:55.357712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:55.358157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:55.358863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:55.359350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:55.359815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:55.441830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lazy-loading 'services' on Instance uuid 11a06384-0ef1-449c-a47a-f2fd14d9f33c {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:35:55.621810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:55.622422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:55.628492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:55.628971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:55.629424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:55.630116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:55.630570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:55.631101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:55.709433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-785d1860-2b0e-43bb-b530-a1cf0afae13e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3837af0d-9964-45c3-bee5-cd51fdd847f1" status: 202 len: 0 microversion: 2.1 time: 0.362605 Aug 31 19:35:55.710037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 512/1016] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:35:55 2022] DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments/3837af0d-9964-45c3-bee5-cd51fdd847f1 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:35:55.770897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:55.779670 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eb897dff-fb35-462f-9e71-0fb88e0d21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.161843 Aug 31 19:35:55.780276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 505/1017] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:55 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:35:56.801396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:56.802095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:56.808701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:56.809215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:56.809686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:56.810396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:56.810849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:56.811294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:56.944773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:56.952818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-909d6e6f-3d52-4432-a69d-c4ba0f433a0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.156049 Aug 31 19:35:56.953382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 513/1018] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:56 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:57.974191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:57.974846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:57.977272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:57.982323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:57.982806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:57.983271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:57.983966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:57.984423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:57.984850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:58.116480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:58.124087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f84f747c-dc99-473f-aaf2-a0f3bdde803a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.153793 Aug 31 19:35:58.124645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 506/1019] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:57 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:35:59.145758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:35:59.146768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:35:59.148517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:35:59.154840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:59.155368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:59.155811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:59.156555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:35:59.157020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:35:59.157518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:35:59.291650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:35:59.299673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-481c359a-2e0a-45e2-a17e-52f29e340b99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.157923 Aug 31 19:35:59.300234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 514/1020] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:35:59 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:00.053511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:00.056803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:00.058647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=8 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:00.063949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.064446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.064893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.065640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.066055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.066486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.070203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:00.096317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-83dc9b1b-cf16-42b7-8311-b829f4c50de4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047194 Aug 31 19:36:00.096932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 507/1021] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:36:00 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:36:00.214089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:00.216407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:00.222794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.223322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.223760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.224450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.224903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.225329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.254911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1c5b2801-22da-4402-81b4-62e25e362799 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044728 Aug 31 19:36:00.255455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 515/1022] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:36:00 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:36:00.318771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:00.319375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:00.320435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:00.321059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:00.327597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.328054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.328201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.328582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.328751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.329050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.329567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.329757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.330101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.330607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.330728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.330970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.358527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:36:00.472401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:00.480740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-85c198e8-249b-480a-9b4d-9fae6641140f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.164117 Aug 31 19:36:00.481323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 516/1023] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:00 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:36:00.665346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8fe22f2a-f7e0-4885-b743-15b8b0f247bc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 204 len: 0 microversion: 2.1 time: 0.350202 Aug 31 19:36:00.666258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 508/1024] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:36:00 2022] DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:36:00.675046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:00.675689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:00.682927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.683524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.683986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.684766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:00.685368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:00.685809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:00.817303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:00.825775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2429d38d-2919-43c3-8939-d36b5f097efc tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1673 microversion: 2.1 time: 0.155009 Aug 31 19:36:00.826344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 517/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:00 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:01.502530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:01.503314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:01.510357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:01.510851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:01.511322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:01.512034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:01.512497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:01.512927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:01.650697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:01.658813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a2ecd482-ff7f-4846-a4bd-625f63bdf624 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.160432 Aug 31 19:36:01.659419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 509/1026] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:01 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:01.846471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-8acf8c57-8eb6-4530-acdc-7646ad42c243 req-25b22fb6-04be-4d72-bc93-d50efd8a99d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e12e83c-b998-423b-a10f-ca1d120457c5", "name": "network-vif-plugged", "status": "completed", "tag": "f06043a7-09af-4461-adf6-f90f75c82f7d"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:01.847842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:01.848534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:01.855835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:01.856344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:01.856870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:01.857209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-8acf8c57-8eb6-4530-acdc-7646ad42c243 req-25b22fb6-04be-4d72-bc93-d50efd8a99d3 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:01.857582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:01.857686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-8acf8c57-8eb6-4530-acdc-7646ad42c243 req-25b22fb6-04be-4d72-bc93-d50efd8a99d3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:01.858043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:01.858152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-8acf8c57-8eb6-4530-acdc-7646ad42c243 req-25b22fb6-04be-4d72-bc93-d50efd8a99d3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:01.858475 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:01.870664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-8acf8c57-8eb6-4530-acdc-7646ad42c243 req-25b22fb6-04be-4d72-bc93-d50efd8a99d3 service nova] Creating event network-vif-plugged:f06043a7-09af-4461-adf6-f90f75c82f7d for instance 9e12e83c-b998-423b-a10f-ca1d120457c5 on hv-cinder-85220 Aug 31 19:36:01.875775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-8acf8c57-8eb6-4530-acdc-7646ad42c243 req-25b22fb6-04be-4d72-bc93-d50efd8a99d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Aug 31 19:36:01.876373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 518/1027] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:01.992431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:02.000582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-52190aba-b93e-4372-afbd-d4fb932ae55a tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1673 microversion: 2.1 time: 0.156946 Aug 31 19:36:02.001158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 510/1028] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:01 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:36:02.682501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:02.682810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:02.689065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:02.689556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:02.690033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:02.690729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:02.691229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:02.691665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:02.863560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:02.872038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8b6010a3-9bab-4962-ae1f-768220c4f14d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.195546 Aug 31 19:36:02.877246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 519/1029] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:02 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:03.022184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:03.022919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:03.029468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:03.029970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:03.030390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:03.031124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:03.031587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:03.032006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:03.163231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:03.171994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f1b99d0d-2d43-4886-b088-db7bb07bd24f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1673 microversion: 2.1 time: 0.154070 Aug 31 19:36:03.172598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 511/1030] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:03 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:03.893820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:03.894421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:03.900994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:03.901478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:03.901994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:03.902695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:03.903344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:03.903775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:04.040072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:04.048596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c3caaa2e-12ba-4829-b924-dc2728ac5bd0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.158774 Aug 31 19:36:04.049168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 520/1031] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:03 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:04.194431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:04.195056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:04.201675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:04.202153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:04.202591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:04.203319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:04.203776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:04.204235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:04.339287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:04.347319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8b5ad454-685d-45c1-8373-521c3d15b61f tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1673 microversion: 2.1 time: 0.156902 Aug 31 19:36:04.347898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 512/1032] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:04 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:05.075306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:05.076607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:05.087220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:05.089148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:05.090041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:05.091335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:05.092175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:05.092969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:05.371036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:05.371971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:05.379782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:05.380724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:05.381166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:05.381894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:05.382518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:05.383160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:05.456710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:05.465192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-55166fea-2d2a-4d58-9494-4b33c5f7efa5 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1606 microversion: 2.1 time: 0.098971 Aug 31 19:36:05.465783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 513/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:05 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1606 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:05.590405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-b80c1d91-7bfa-4472-856f-4377e87b8379 req-c92d973f-10be-4d26-b2b7-78fa67377031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11a06384-0ef1-449c-a47a-f2fd14d9f33c", "name": "network-vif-deleted", "tag": "ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:05.601040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b80c1d91-7bfa-4472-856f-4377e87b8379 req-c92d973f-10be-4d26-b2b7-78fa67377031 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:05.601525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b80c1d91-7bfa-4472-856f-4377e87b8379 req-c92d973f-10be-4d26-b2b7-78fa67377031 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:05.601964 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b80c1d91-7bfa-4472-856f-4377e87b8379 req-c92d973f-10be-4d26-b2b7-78fa67377031 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:05.620802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-b80c1d91-7bfa-4472-856f-4377e87b8379 req-c92d973f-10be-4d26-b2b7-78fa67377031 service nova] Creating event network-vif-deleted:ab98d715-a3f3-4d2e-861f-2f7d4d5ff1b1 for instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c on hv-cinder-85220 Aug 31 19:36:05.627780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-b80c1d91-7bfa-4472-856f-4377e87b8379 req-c92d973f-10be-4d26-b2b7-78fa67377031 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041991 Aug 31 19:36:05.629084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 514/1034] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:36:05.632561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:05.642625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-948e988a-9d3b-4420-9e8f-12f3397a472c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1367 microversion: 2.1 time: 0.576196 Aug 31 19:36:05.644379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 521/1035] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:05 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1367 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:06.488157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:06.488930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:06.495806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.496304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.496752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:06.497605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.498073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.498541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:06.533937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.534430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.534865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:06.535335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lazy-loading 'fault' on Instance uuid 11a06384-0ef1-449c-a47a-f2fd14d9f33c {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:36:06.578100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bc4801f1f674f55b57d49e5f09205ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a13c903a376b46508e8cccbcb20b484c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:06.586077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b8e303c7-0bf3-400c-98eb-3349c48f88a2 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 200 len: 1327 microversion: 2.1 time: 0.102597 Aug 31 19:36:06.586655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 515/1036] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:06 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:06.667273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:06.667897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:06.674808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.675687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.676143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:06.677038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.677507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.677940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:06.814108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:06.822085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7c7a8f18-514d-47d7-9069-cd32628a6c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1558 microversion: 2.1 time: 0.160349 Aug 31 19:36:06.822678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 522/1037] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:06 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:06.842713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:06.843240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:06.849203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.849688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.850224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:06.851046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:06.851512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:06.851933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:07.085506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a7b37df4-afbf-45e5-85e1-8125344084b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.246601 Aug 31 19:36:07.086101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 516/1038] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:36:06 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/os-interface => generated 285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:07.607267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:07.607996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:07.614272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:07.614860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:07.615397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:07.616189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:07.616725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:07.617227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:07.632175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] HTTP exception thrown: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Request method failure captured: Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c HTTP/1.1 Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WW0thITDhbmXL8Q3_vfLB6pK24byVW1EeIfVHgxwLn5FgDb1LFqJSG1j5mzWnkcuEPl16QaydQH1r9VPSrryvdiKnqtNIPMVEfxt_BIMsfmOm_ELmGRWGwBlNQMvgiT99wwM0aGI-cyqsEKT3zbE9QvwJ-AMFk6PfhLRtb2YKS09A Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:07.634513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a13c903a376b46508e8cccbcb20b484c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 8bc4801f1f674f55b57d49e5f09205ea Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:07.636518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '11a06384-0ef1-449c-a47a-f2fd14d9f33c'} Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:07.640856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:07.642507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:07.643937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Returning 404 to user: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:07.643937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f61eeed4-bae1-4636-954a-99d6a4460b3e tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 404 len: 111 microversion: 2.1 time: 0.033068 Aug 31 19:36:07.643937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 523/1039] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:07 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:07.645545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bd8764d-5162-4641-bf80-e58552665a23 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '.version_select at 0x7ff6cb29f040>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:07.751791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bd8764d-5162-4641-bf80-e58552665a23 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-913221887" status: 202 len: 0 microversion: 2.1 time: 0.110132 Aug 31 19:36:07.752481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 517/1040] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 31 19:36:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-913221887 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:36:08.375010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-24c00554-bf43-4607-afde-7909588368a9 req-aaa61307-9c81-4ea6-92d0-00253f7a023f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e12e83c-b998-423b-a10f-ca1d120457c5", "tag": "f06043a7-09af-4461-adf6-f90f75c82f7d"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:08.385349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-24c00554-bf43-4607-afde-7909588368a9 req-aaa61307-9c81-4ea6-92d0-00253f7a023f service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:08.385836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-24c00554-bf43-4607-afde-7909588368a9 req-aaa61307-9c81-4ea6-92d0-00253f7a023f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:08.386447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-24c00554-bf43-4607-afde-7909588368a9 req-aaa61307-9c81-4ea6-92d0-00253f7a023f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:08.390621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:08.398034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-24c00554-bf43-4607-afde-7909588368a9 req-aaa61307-9c81-4ea6-92d0-00253f7a023f service nova] Creating event network-changed:f06043a7-09af-4461-adf6-f90f75c82f7d for instance 9e12e83c-b998-423b-a10f-ca1d120457c5 on hv-cinder-85220 Aug 31 19:36:08.403853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-24c00554-bf43-4607-afde-7909588368a9 req-aaa61307-9c81-4ea6-92d0-00253f7a023f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098567 Aug 31 19:36:08.416528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 524/1041] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:11.286754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:11.287372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:11.294563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:11.295564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:11.295564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:11.296252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:11.296719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:11.297180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:11.311768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] HTTP exception thrown: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Request method failure captured: Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c HTTP/1.1 Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WW0thITDhbmXL8Q3_vfLB6pK24byVW1EeIfVHgxwLn5FgDb1LFqJSG1j5mzWnkcuEPl16QaydQH1r9VPSrryvdiKnqtNIPMVEfxt_BIMsfmOm_ELmGRWGwBlNQMvgiT99wwM0aGI-cyqsEKT3zbE9QvwJ-AMFk6PfhLRtb2YKS09A Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:11.313494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a13c903a376b46508e8cccbcb20b484c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 8bc4801f1f674f55b57d49e5f09205ea Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.315187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '11a06384-0ef1-449c-a47a-f2fd14d9f33c'} Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:11.316432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.318205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.319877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Returning 404 to user: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:11.319877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-da84ce71-1f43-47db-9cd9-5332bc19453b tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 404 len: 111 microversion: 2.1 time: 0.032938 Aug 31 19:36:11.319877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 518/1042] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:36:11 2022] DELETE /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:11.324778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:11.325801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 11a06384-0ef1-449c-a47a-f2fd14d9f33c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:11.333905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:11.338428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:11.338428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:11.338428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:11.338428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:11.338819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:11.350210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] HTTP exception thrown: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Request method failure captured: Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c HTTP/1.1 Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WW0thITDhbmXL8Q3_vfLB6pK24byVW1EeIfVHgxwLn5FgDb1LFqJSG1j5mzWnkcuEPl16QaydQH1r9VPSrryvdiKnqtNIPMVEfxt_BIMsfmOm_ELmGRWGwBlNQMvgiT99wwM0aGI-cyqsEKT3zbE9QvwJ-AMFk6PfhLRtb2YKS09A Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:11.351906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a13c903a376b46508e8cccbcb20b484c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 8bc4801f1f674f55b57d49e5f09205ea Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.354156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '11a06384-0ef1-449c-a47a-f2fd14d9f33c'} Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:11.355645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. Aug 31 19:36:11.357136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:11.358466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Returning 404 to user: Instance 11a06384-0ef1-449c-a47a-f2fd14d9f33c could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:11.358466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0fb62372-2a3b-425e-9a88-08e0124f3fab tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c" status: 404 len: 111 microversion: 2.1 time: 0.033580 Aug 31 19:36:11.358466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 525/1043] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:11 2022] GET /compute/v2.1/servers/11a06384-0ef1-449c-a47a-f2fd14d9f33c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:12.622005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:12.622549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:12.629022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:12.629510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:12.629951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:12.630649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:12.631146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:12.631576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:12.645782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] HTTP exception thrown: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Request method failure captured: Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a HTTP/1.1 Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WW0thITDhbmXL8Q3_vfLB6pK24byVW1EeIfVHgxwLn5FgDb1LFqJSG1j5mzWnkcuEPl16QaydQH1r9VPSrryvdiKnqtNIPMVEfxt_BIMsfmOm_ELmGRWGwBlNQMvgiT99wwM0aGI-cyqsEKT3zbE9QvwJ-AMFk6PfhLRtb2YKS09A Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:12.647384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a13c903a376b46508e8cccbcb20b484c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 8bc4801f1f674f55b57d49e5f09205ea Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.648990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '2cf99492-1198-453d-9f3b-f4f8bdbc225a'} Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:12.650195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.651703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.653022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Returning 404 to user: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:12.653022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bdfbe914-78b6-47b6-8dc0-7c4a0466e8bd tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 404 len: 111 microversion: 2.1 time: 0.031204 Aug 31 19:36:12.653022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 519/1044] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:36:12 2022] DELETE /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:12.657626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:12.658297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] [instance: 2cf99492-1198-453d-9f3b-f4f8bdbc225a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:12.665278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:12.665805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:12.666313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:12.667064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:12.667524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:12.667952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:12.682312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] HTTP exception thrown: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Request method failure captured: Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a HTTP/1.1 Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WW0thITDhbmXL8Q3_vfLB6pK24byVW1EeIfVHgxwLn5FgDb1LFqJSG1j5mzWnkcuEPl16QaydQH1r9VPSrryvdiKnqtNIPMVEfxt_BIMsfmOm_ELmGRWGwBlNQMvgiT99wwM0aGI-cyqsEKT3zbE9QvwJ-AMFk6PfhLRtb2YKS09A Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:12.683902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a13c903a376b46508e8cccbcb20b484c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a13c903a376b46508e8cccbcb20b484c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: a13c903a376b46508e8cccbcb20b484c Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1556293320 Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 8bc4801f1f674f55b57d49e5f09205ea Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeTestJSON-1556293320-project Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.685588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '2cf99492-1198-453d-9f3b-f4f8bdbc225a'} Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:12.686485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. Aug 31 19:36:12.687748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:12.688920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] Returning 404 to user: Instance 2cf99492-1198-453d-9f3b-f4f8bdbc225a could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:12.688920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-40272832-edc0-4f9c-970b-263abd472db4 tempest-AttachVolumeTestJSON-1556293320 tempest-AttachVolumeTestJSON-1556293320-project] 10.222.0.59 "GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a" status: 404 len: 111 microversion: 2.1 time: 0.031676 Aug 31 19:36:12.688920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 526/1045] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:12 2022] GET /compute/v2.1/servers/2cf99492-1198-453d-9f3b-f4f8bdbc225a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:43.034034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:43.036317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:43.038614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:43.039311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:43.044279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:43.045339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:43.045825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:43.046669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:43.047296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:43.047976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:43.084162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9ffa9eb9-383f-4fb0-b49e-3198c4772705 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054320 Aug 31 19:36:43.084729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 520/1046] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 31 19:36:43 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:43.156750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:43.161063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:43.161063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=43 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:43.161063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=4 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:36:43.164930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:43.165419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:43.165852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:43.166552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:43.167055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:43.167480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:43.197452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:36:43.635508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-17d8a6c2-5d9e-4fff-9c2f-df8d67b77170 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 204 len: 0 microversion: 2.20 time: 0.482861 Aug 31 19:36:43.636129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 527/1047] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 31 19:36:43 2022] DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 19:36:43.646013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:43.647928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:43.653471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:43.653972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:43.655075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:43.655896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:43.656358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:43.656880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:43.797250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:43.803033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:43.804507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:43.805709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-804bfb5e-6c0a-420f-92d0-85ead9f6539d tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.164314 Aug 31 19:36:43.806259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 521/1048] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:43 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:36:44.830161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:44.830860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:44.837658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:44.838147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:44.838587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:44.839319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:44.839786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:44.840216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:44.972578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:44.980816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:44.982374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:44.983591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a153c656-115d-4cee-bd45-7bcbb77b3817 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.158017 Aug 31 19:36:44.984160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 528/1049] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:44 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:36:46.005838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:46.006486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:46.015612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:46.016112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:46.016547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:46.019870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:46.019870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:46.019870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:46.150947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:46.160464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:46.161915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:46.163156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-50d4bdb2-7fbb-41b8-8db3-21859152968a tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1723 microversion: 2.20 time: 0.161382 Aug 31 19:36:46.163704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 522/1050] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:46 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:36:46.907366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-30ca51c4-207e-4ca3-9c7c-2e3cd1e119cb req-3652c632-b469-4caf-9d42-451ca8a77015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d3e627d-6271-4e22-a196-daf63472224e", "name": "network-vif-deleted", "tag": "83152818-5bbc-4d55-82e7-aead38060634"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:46.921174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-30ca51c4-207e-4ca3-9c7c-2e3cd1e119cb req-3652c632-b469-4caf-9d42-451ca8a77015 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:46.921765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-30ca51c4-207e-4ca3-9c7c-2e3cd1e119cb req-3652c632-b469-4caf-9d42-451ca8a77015 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:46.922281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-30ca51c4-207e-4ca3-9c7c-2e3cd1e119cb req-3652c632-b469-4caf-9d42-451ca8a77015 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:46.937851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-30ca51c4-207e-4ca3-9c7c-2e3cd1e119cb req-3652c632-b469-4caf-9d42-451ca8a77015 service nova] Creating event network-vif-deleted:83152818-5bbc-4d55-82e7-aead38060634 for instance 3d3e627d-6271-4e22-a196-daf63472224e on hv-cinder-85220 Aug 31 19:36:46.943738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-30ca51c4-207e-4ca3-9c7c-2e3cd1e119cb req-3652c632-b469-4caf-9d42-451ca8a77015 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177262 Aug 31 19:36:46.944466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 529/1051] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:47.186010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:47.186719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:47.193221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:47.193921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:47.194358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:47.195114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:47.195569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:47.195993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:47.233196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:47.233676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:47.234111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:47.234930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lazy-loading 'fault' on Instance uuid 3d3e627d-6271-4e22-a196-daf63472224e {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:36:47.284516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:47.293563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:47.295281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d5336bcea514f378e06737680ae9bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b5588a49a314579a29bad0f73aae8b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:47.296690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-40358c70-abd3-4e93-b6f9-a8e3d41bd007 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 200 len: 1371 microversion: 2.20 time: 0.114857 Aug 31 19:36:47.297250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 523/1052] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:47 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 19:36:48.321327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:48.322913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:48.329468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:48.329949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:48.330388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:48.331110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:48.331568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:48.331994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:48.345816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] HTTP exception thrown: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Request method failure captured: Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e HTTP/1.1 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WXVmz_gpBCYe66_i2KIbHso51-1r0bFPXWBq36lOg9NvyMUeirJa3u6ePAQkddiGMsQuhPfPd-5t6SckvbC8eXxWc1FCH_YH7Rwokf8Kl1mwABK9H9gfkDvHPnBMP427LMWlGu0oERHxerPbUimeZdZVKZz3zhGpWwJvKZn00N_-g Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:48.347495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4b5588a49a314579a29bad0f73aae8b4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 0d5336bcea514f378e06737680ae9bdc Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:48.350229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '3d3e627d-6271-4e22-a196-daf63472224e'} Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:48.352045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:48.354829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:48.357042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Returning 404 to user: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:48.357042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c7de2394-3a7c-4d31-ad90-0086708eb98e tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 404 len: 111 microversion: 2.20 time: 0.032123 Aug 31 19:36:48.357042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 530/1053] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:48 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:48.359850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fb4f5e7c-92a1-41fc-b774-c46762d07afc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '.version_select at 0x7ff6cb3a0c10>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:48.447990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fb4f5e7c-92a1-41fc-b774-c46762d07afc tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101265006" status: 204 len: 0 microversion: 2.20 time: 0.092211 Aug 31 19:36:48.448611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 524/1054] 10.222.0.59 () {60 vars in 1259 bytes} [Wed Aug 31 19:36:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101265006 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 19:36:50.438099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:50.438642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:50.445124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:50.445609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:50.446050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:50.446742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:50.447305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:50.447738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:50.461940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] HTTP exception thrown: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Request method failure captured: Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e HTTP/1.1 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WXVmz_gpBCYe66_i2KIbHso51-1r0bFPXWBq36lOg9NvyMUeirJa3u6ePAQkddiGMsQuhPfPd-5t6SckvbC8eXxWc1FCH_YH7Rwokf8Kl1mwABK9H9gfkDvHPnBMP427LMWlGu0oERHxerPbUimeZdZVKZz3zhGpWwJvKZn00N_-g Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:50.463533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4b5588a49a314579a29bad0f73aae8b4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 0d5336bcea514f378e06737680ae9bdc Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.465215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '3d3e627d-6271-4e22-a196-daf63472224e'} Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:50.467048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.468819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.470464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Returning 404 to user: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:50.470464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-046f9419-0845-4031-a346-a2f570471d20 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 404 len: 111 microversion: 2.20 time: 0.030841 Aug 31 19:36:50.470464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 531/1055] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 31 19:36:50 2022] DELETE /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:50.474754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:50.475400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: 3d3e627d-6271-4e22-a196-daf63472224e] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:50.482685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:50.483200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:50.483647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:50.484684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:50.484931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:50.485366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:50.498650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] HTTP exception thrown: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Request method failure captured: Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e HTTP/1.1 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WXVmz_gpBCYe66_i2KIbHso51-1r0bFPXWBq36lOg9NvyMUeirJa3u6ePAQkddiGMsQuhPfPd-5t6SckvbC8eXxWc1FCH_YH7Rwokf8Kl1mwABK9H9gfkDvHPnBMP427LMWlGu0oERHxerPbUimeZdZVKZz3zhGpWwJvKZn00N_-g Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:50.500321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4b5588a49a314579a29bad0f73aae8b4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 0d5336bcea514f378e06737680ae9bdc Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.501998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '3d3e627d-6271-4e22-a196-daf63472224e'} Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:50.505881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. Aug 31 19:36:50.507379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:50.509170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Returning 404 to user: Instance 3d3e627d-6271-4e22-a196-daf63472224e could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:50.509170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a28b8f8-9c12-4162-a39e-9635e9968530 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e" status: 404 len: 111 microversion: 2.20 time: 0.031042 Aug 31 19:36:50.509170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 525/1056] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:50 2022] GET /compute/v2.1/servers/3d3e627d-6271-4e22-a196-daf63472224e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:51.802029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:51.802608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:51.808922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:51.809424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:51.809918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:51.811398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:51.811867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:51.812303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] HTTP exception thrown: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Request method failure captured: Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a HTTP/1.1 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7WXVmz_gpBCYe66_i2KIbHso51-1r0bFPXWBq36lOg9NvyMUeirJa3u6ePAQkddiGMsQuhPfPd-5t6SckvbC8eXxWc1FCH_YH7Rwokf8Kl1mwABK9H9gfkDvHPnBMP427LMWlGu0oERHxerPbUimeZdZVKZz3zhGpWwJvKZn00N_-g Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:51.831558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4b5588a49a314579a29bad0f73aae8b4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 0d5336bcea514f378e06737680ae9bdc Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.834318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': 'e6b4eccf-f5b2-4847-8f27-6202e7c2a81a'} Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:51.835151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.836520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.838166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Returning 404 to user: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:51.838166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-18d325be-9c6e-484f-92ee-7b97f388a3fa tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 404 len: 111 microversion: 2.20 time: 0.033146 Aug 31 19:36:51.838166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 532/1057] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 31 19:36:51 2022] DELETE /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 19:36:51.838821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:51.839459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] [instance: e6b4eccf-f5b2-4847-8f27-6202e7c2a81a] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:51.846007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:51.846501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:51.846962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:51.847704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:51.848165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:51.848593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:51.863134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] HTTP exception thrown: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Request method failure captured: Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a HTTP/1.1 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7WXVmz_gpBCYe66_i2KIbHso51-1r0bFPXWBq36lOg9NvyMUeirJa3u6ePAQkddiGMsQuhPfPd-5t6SckvbC8eXxWc1FCH_YH7Rwokf8Kl1mwABK9H9gfkDvHPnBMP427LMWlGu0oERHxerPbUimeZdZVKZz3zhGpWwJvKZn00N_-g Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:51.864678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4b5588a49a314579a29bad0f73aae8b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4b5588a49a314579a29bad0f73aae8b4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 4b5588a49a314579a29bad0f73aae8b4 Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1004634362 Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 0d5336bcea514f378e06737680ae9bdc Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1004634362-project Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.866183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'e6b4eccf-f5b2-4847-8f27-6202e7c2a81a'} Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:51.867477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. Aug 31 19:36:51.869060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:51.877033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] Returning 404 to user: Instance e6b4eccf-f5b2-4847-8f27-6202e7c2a81a could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:51.877033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b529a63c-c52d-4c8a-8458-f2e3341c39a6 tempest-AttachVolumeShelveTestJSON-1004634362 tempest-AttachVolumeShelveTestJSON-1004634362-project] 10.222.0.59 "GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a" status: 404 len: 111 microversion: 2.20 time: 0.031253 Aug 31 19:36:51.877033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 526/1058] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 31 19:36:51 2022] GET /compute/v2.1/servers/e6b4eccf-f5b2-4847-8f27-6202e7c2a81a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:53.300840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:53.301349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:53.306930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-dd3333c6-fbc0-4ab4-ac25-6e6dea77a8b9 req-1bf08936-b0f3-465d-a385-c70995ebc5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664fdd1e-5df7-41ec-93d8-3412f341da30", "tag": "e25476ad-a151-4b68-9a71-999950b01698"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:53.320352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.321918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.325751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-dd3333c6-fbc0-4ab4-ac25-6e6dea77a8b9 req-1bf08936-b0f3-465d-a385-c70995ebc5a1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.326415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.327292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.328100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.328547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.333566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-dd3333c6-fbc0-4ab4-ac25-6e6dea77a8b9 req-1bf08936-b0f3-465d-a385-c70995ebc5a1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.334977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-dd3333c6-fbc0-4ab4-ac25-6e6dea77a8b9 req-1bf08936-b0f3-465d-a385-c70995ebc5a1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.352870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-dd3333c6-fbc0-4ab4-ac25-6e6dea77a8b9 req-1bf08936-b0f3-465d-a385-c70995ebc5a1 service nova] Creating event network-changed:e25476ad-a151-4b68-9a71-999950b01698 for instance 664fdd1e-5df7-41ec-93d8-3412f341da30 on hv-cinder-85220 Aug 31 19:36:53.359014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-dd3333c6-fbc0-4ab4-ac25-6e6dea77a8b9 req-1bf08936-b0f3-465d-a385-c70995ebc5a1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055134 Aug 31 19:36:53.359910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 527/1059] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:53.369432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:36:53.635675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-35a7934f-72ff-4f28-a0c6-538e983a012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "DELETE /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 204 len: 0 microversion: 2.1 time: 0.338372 Aug 31 19:36:53.636732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 533/1060] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:36:53 2022] DELETE /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:36:53.645604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:53.646318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:53.657135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.657633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.658272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.658814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:53.663544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:53.670258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:53.936909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:53.946403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09ae72e9-ccfe-45fc-b8cc-bcbd467ef97b tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1575 microversion: 2.1 time: 0.304973 Aug 31 19:36:53.959092 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 528/1061] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:53 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1575 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:54.974410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:54.975207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:54.982059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:54.982894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:54.983356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:54.984080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:54.984953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:54.984953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:55.212786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:55.227993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-45ca10de-cdaf-4bce-9aa2-4f1b6024f799 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1575 microversion: 2.1 time: 0.257962 Aug 31 19:36:55.233863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 534/1062] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:54 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:56.250354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:56.251116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:56.257628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:56.258197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:56.258707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:56.259505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:56.260046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:56.260566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:56.405799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:56.413971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-65180192-1842-477b-a7b0-dc0152f7012e tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1457 microversion: 2.1 time: 0.168504 Aug 31 19:36:56.414655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 529/1063] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:56 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1457 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:56.826059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-ea0a712c-7d26-4346-ae9a-e4acfce2929b req-479bc33a-b09b-4266-9152-cbb43f64e2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664fdd1e-5df7-41ec-93d8-3412f341da30", "name": "network-vif-deleted", "tag": "e25476ad-a151-4b68-9a71-999950b01698"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:56.841732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-ea0a712c-7d26-4346-ae9a-e4acfce2929b req-479bc33a-b09b-4266-9152-cbb43f64e2d3 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:56.842485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-ea0a712c-7d26-4346-ae9a-e4acfce2929b req-479bc33a-b09b-4266-9152-cbb43f64e2d3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:56.843139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-ea0a712c-7d26-4346-ae9a-e4acfce2929b req-479bc33a-b09b-4266-9152-cbb43f64e2d3 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:56.855256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-ea0a712c-7d26-4346-ae9a-e4acfce2929b req-479bc33a-b09b-4266-9152-cbb43f64e2d3 service nova] Creating event network-vif-deleted:e25476ad-a151-4b68-9a71-999950b01698 for instance 664fdd1e-5df7-41ec-93d8-3412f341da30 on hv-cinder-85220 Aug 31 19:36:56.862036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-ea0a712c-7d26-4346-ae9a-e4acfce2929b req-479bc33a-b09b-4266-9152-cbb43f64e2d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042437 Aug 31 19:36:56.862688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 535/1064] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:36:57.441516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:57.442142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:57.448896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:57.449387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:57.449856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:57.450602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:57.451987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:57.452444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:57.514896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:36:57.522895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8da75722-37f4-43f8-8ba6-f14af04878af tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 200 len: 1224 microversion: 2.1 time: 0.089427 Aug 31 19:36:57.523581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 530/1065] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:57 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:36:58.301345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a0e12800-9b60-4e2a-bd18-ed595d3479e7 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Action: 'create', calling method: .version_select at 0x7ff6cb630790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-6847261", "metadata": {"Type": "work"}}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a0e12800-9b60-4e2a-bd18-ed595d3479e7 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Request method failure captured: Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 119 Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7haXyjmHFOIMS79LxEkw93gc_zrHc8InMnZBw694is_16PSaSekA0vs447GtSHZgPf7F15YkM8w0V3a7Cn9p0VF6U5mxoTuKIsppCcg3_j6t8MDeA1dgxbSvpy4yKkhInIKWeRzubIMtiQ5BG_WSogKJGw8a959whnj6919zKuch0o Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:58.314015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81de45a633e64b958a13f991d1a4bf9f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 109c80ca49cd41b49330776bebf4c6a0 Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-6847261", "metadata": {"Type": "work"}}} Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: Aug 31 19:36:58.315574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-6847261', 'metadata': {'Type': 'work'}}}} Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.316618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:36:58.318140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:36:58.319533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 19:36:58.319533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.319533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a0e12800-9b60-4e2a-bd18-ed595d3479e7 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.319533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a0e12800-9b60-4e2a-bd18-ed595d3479e7 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141629 Aug 31 19:36:58.319533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 536/1066] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 31 19:36:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:58.323688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e8bb7a7a-a9ad-4379-b7d9-e1859dc7149b tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Action: 'create', calling method: .version_select at 0x7ff6cb3a00d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1383782698", "metadata": {"Type": "work"}}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e8bb7a7a-a9ad-4379-b7d9-e1859dc7149b tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Request method failure captured: Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 120 Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7haXyjmHFOIMS79LxEkw93gc_zrHc8InMnZBw694is_16PSaSekA0vs447GtSHZgPf7F15YkM8w0V3a7Cn9p0VF6U5mxoTuKIsppCcg3_j6t8MDeA1dgxbSvpy4yKkhInIKWeRzubIMtiQ5BG_WSogKJGw8a959whnj6919zKuch0o Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:58.328409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81de45a633e64b958a13f991d1a4bf9f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 109c80ca49cd41b49330776bebf4c6a0 Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1383782698", "metadata": {"Type": "work"}}} Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:36:58.330036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1383782698', 'metadata': {'Type': 'work'}}}} Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi '0' Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:36:58.339882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:36:58.341605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 19:36:58.341605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.341605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e8bb7a7a-a9ad-4379-b7d9-e1859dc7149b tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.341605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e8bb7a7a-a9ad-4379-b7d9-e1859dc7149b tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010115 Aug 31 19:36:58.341605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 531/1067] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 31 19:36:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:58.347367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ee926a66-e56a-4168-a97a-0152a2af55a0 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Action: 'create', calling method: .version_select at 0x7ff6cb59e790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1560525260", "metadata": {"Type": "work"}}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ee926a66-e56a-4168-a97a-0152a2af55a0 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Request method failure captured: Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 119 Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7haXyjmHFOIMS79LxEkw93gc_zrHc8InMnZBw694is_16PSaSekA0vs447GtSHZgPf7F15YkM8w0V3a7Cn9p0VF6U5mxoTuKIsppCcg3_j6t8MDeA1dgxbSvpy4yKkhInIKWeRzubIMtiQ5BG_WSogKJGw8a959whnj6919zKuch0o Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:58.351887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81de45a633e64b958a13f991d1a4bf9f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 109c80ca49cd41b49330776bebf4c6a0 Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1560525260", "metadata": {"Type": "work"}}} Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: Aug 31 19:36:58.358241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1560525260', 'metadata': {'Type': 'work'}}}} Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise error Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi '' Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.359231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 19:36:58.360840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 19:36:58.362156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 19:36:58.362156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.362156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ee926a66-e56a-4168-a97a-0152a2af55a0 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.362156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ee926a66-e56a-4168-a97a-0152a2af55a0 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010438 Aug 31 19:36:58.362156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 537/1068] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 31 19:36:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:36:58.366203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4dc8a2fa-f783-4b18-8548-5291f3be0d86 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Calling method '.version_select at 0x7ff6cb3d1820>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:58.396614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-4dc8a2fa-f783-4b18-8548-5291f3be0d86 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] HTTP exception thrown: Volume tempest-invalid-851622627 could not be found. Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4dc8a2fa-f783-4b18-8548-5291f3be0d86 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Request method failure captured: Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-851622627 HTTP/1.1 Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7haXyjmHFOIMS79LxEkw93gc_zrHc8InMnZBw694is_16PSaSekA0vs447GtSHZgPf7F15YkM8w0V3a7Cn9p0VF6U5mxoTuKIsppCcg3_j6t8MDeA1dgxbSvpy4yKkhInIKWeRzubIMtiQ5BG_WSogKJGw8a959whnj6919zKuch0o Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:58.398787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81de45a633e64b958a13f991d1a4bf9f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 109c80ca49cd41b49330776bebf4c6a0 Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Volume tempest-invalid-851622627 could not be found. Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'tempest-invalid-851622627'} Aug 31 19:36:58.400374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-851622627 could not be found. (HTTP 404) (Request-ID: req-8286e9d2-ef77-402a-a963-446ab05e0888) Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.401276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:36:58.402481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-851622627 could not be found. Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:58.404261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-851622627 could not be found. Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-851622627 could not be found. Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4dc8a2fa-f783-4b18-8548-5291f3be0d86 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Returning 404 to user: Volume tempest-invalid-851622627 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4dc8a2fa-f783-4b18-8548-5291f3be0d86 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-851622627" status: 404 len: 98 microversion: 2.1 time: 0.037979 Aug 31 19:36:58.405853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 532/1069] 10.222.0.59 () {58 vars in 1215 bytes} [Wed Aug 31 19:36:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-851622627 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 19:36:58.412491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-236c14b3-3691-49d6-ba80-d98ce67c3d41 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004303 Aug 31 19:36:58.413995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 538/1070] 10.222.0.59 () {58 vars in 1140 bytes} [Wed Aug 31 19:36:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 19:36:58.422665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e190221c-8a75-4970-8e2a-4049b90e8427 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004508 Aug 31 19:36:58.423210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 533/1071] 10.222.0.59 () {58 vars in 1137 bytes} [Wed Aug 31 19:36:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 19:36:58.432088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b3cbd8b4-640b-4a69-aa44-90fa3b16dc87 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Calling method '.version_select at 0x7ff6cb5bb820>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:58.462846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-b3cbd8b4-640b-4a69-aa44-90fa3b16dc87 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] HTTP exception thrown: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b3cbd8b4-640b-4a69-aa44-90fa3b16dc87 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Request method failure captured: Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: DELETE /compute/v2.1/os-volumes/ef48855c-66e2-4e72-9982-6ba30218ced9 HTTP/1.1 Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7haXyjmHFOIMS79LxEkw93gc_zrHc8InMnZBw694is_16PSaSekA0vs447GtSHZgPf7F15YkM8w0V3a7Cn9p0VF6U5mxoTuKIsppCcg3_j6t8MDeA1dgxbSvpy4yKkhInIKWeRzubIMtiQ5BG_WSogKJGw8a959whnj6919zKuch0o Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:58.467576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81de45a633e64b958a13f991d1a4bf9f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 109c80ca49cd41b49330776bebf4c6a0 Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': 'ef48855c-66e2-4e72-9982-6ba30218ced9'} Aug 31 19:36:58.469218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. (HTTP 404) (Request-ID: req-da77c595-183e-4e42-ae86-44eaca7d0f49) Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.470266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 19:36:58.471701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 19:36:58.473063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b3cbd8b4-640b-4a69-aa44-90fa3b16dc87 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Returning 404 to user: Volume ef48855c-66e2-4e72-9982-6ba30218ced9 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b3cbd8b4-640b-4a69-aa44-90fa3b16dc87 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ef48855c-66e2-4e72-9982-6ba30218ced9" status: 404 len: 109 microversion: 2.1 time: 0.040930 Aug 31 19:36:58.474373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 539/1072] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:36:58 2022] DELETE /compute/v2.1/os-volumes/ef48855c-66e2-4e72-9982-6ba30218ced9 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:58.479283 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5f8d81a6-f1d2-4337-a2bc-b9cf3e8c22a1 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Calling method '.version_select at 0x7ff6cb3a0430>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:58.507476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-5f8d81a6-f1d2-4337-a2bc-b9cf3e8c22a1 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] HTTP exception thrown: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5f8d81a6-f1d2-4337-a2bc-b9cf3e8c22a1 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Request method failure captured: Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/os-volumes/aff62d23-570e-471b-9b59-712c9a509d87 HTTP/1.1 Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7haXyjmHFOIMS79LxEkw93gc_zrHc8InMnZBw694is_16PSaSekA0vs447GtSHZgPf7F15YkM8w0V3a7Cn9p0VF6U5mxoTuKIsppCcg3_j6t8MDeA1dgxbSvpy4yKkhInIKWeRzubIMtiQ5BG_WSogKJGw8a959whnj6919zKuch0o Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:36:58.509458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81de45a633e64b958a13f991d1a4bf9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81de45a633e64b958a13f991d1a4bf9f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: 81de45a633e64b958a13f991d1a4bf9f Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesNegativeTest-464021389 Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 109c80ca49cd41b49330776bebf4c6a0 Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesNegativeTest-464021389-project Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'aff62d23-570e-471b-9b59-712c9a509d87'} Aug 31 19:36:58.510847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. (HTTP 404) (Request-ID: req-5e34ff69-60f9-4e33-8181-6fc04a1e2c63) Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.512097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 19:36:58.514072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 19:36:58.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5f8d81a6-f1d2-4337-a2bc-b9cf3e8c22a1 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] Returning 404 to user: Volume aff62d23-570e-471b-9b59-712c9a509d87 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5f8d81a6-f1d2-4337-a2bc-b9cf3e8c22a1 tempest-VolumesNegativeTest-464021389 tempest-VolumesNegativeTest-464021389-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/aff62d23-570e-471b-9b59-712c9a509d87" status: 404 len: 109 microversion: 2.1 time: 0.035914 Aug 31 19:36:58.517137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 534/1073] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 31 19:36:58 2022] GET /compute/v2.1/os-volumes/aff62d23-570e-471b-9b59-712c9a509d87 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:36:58.549754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:36:58.550489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 664fdd1e-5df7-41ec-93d8-3412f341da30] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:36:58.557674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:58.558162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:58.558827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:58.559589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:36:58.560282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:36:58.560778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:36:58.579236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] HTTP exception thrown: Instance 664fdd1e-5df7-41ec-93d8-3412f341da30 could not be found. Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Request method failure captured: Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 HTTP/1.1 Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7YCfQ5V5_DHt2fXjpw2aefUmJUuwo2COV0-JW1B92ifUamKr3NY58yr97i-qKBGt_y2QME6B6zoqOLYfIIUSp7HJlswiKBkzOpqtuHtb4fkmsqBnO_K88xcE-vdzVfmLr4LIgl1biaqamhBIa03EMZWm5cO1PW87J0Cy1fWZGjfvbY Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:36:58.580855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8bfa72ff61547e5a3097e5b40483f8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: be55f0bb21f044b0a8346cf953b1650e Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 664fdd1e-5df7-41ec-93d8-3412f341da30 could not be found. Aug 31 19:36:58.582219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '664fdd1e-5df7-41ec-93d8-3412f341da30'} Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 664fdd1e-5df7-41ec-93d8-3412f341da30 could not be found. Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:36:58.590459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 664fdd1e-5df7-41ec-93d8-3412f341da30 could not be found. Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 664fdd1e-5df7-41ec-93d8-3412f341da30 could not be found. Aug 31 19:36:58.592554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:36:58.593662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Returning 404 to user: Instance 664fdd1e-5df7-41ec-93d8-3412f341da30 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:36:58.593662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-003c7e8b-8c39-4ed0-be4c-c3727a72b4c4 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30" status: 404 len: 111 microversion: 2.1 time: 0.036358 Aug 31 19:36:58.593662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 540/1074] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:36:58 2022] GET /compute/v2.1/servers/664fdd1e-5df7-41ec-93d8-3412f341da30 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:37:02.126331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:02.127339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:02.135567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.136065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.136510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.136949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-b503377d-e49d-4815-8758-31e8c695b19a req-64567f33-7005-4495-84f0-31eac8ec977a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b1b1d14-7d79-404f-865d-c089acfe0f07", "tag": "e63545f3-23e2-4661-adee-df5faf473949"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:02.137433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.137668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.138265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.156743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b503377d-e49d-4815-8758-31e8c695b19a req-64567f33-7005-4495-84f0-31eac8ec977a service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.157353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b503377d-e49d-4815-8758-31e8c695b19a req-64567f33-7005-4495-84f0-31eac8ec977a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.157726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b503377d-e49d-4815-8758-31e8c695b19a req-64567f33-7005-4495-84f0-31eac8ec977a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.172302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-b503377d-e49d-4815-8758-31e8c695b19a req-64567f33-7005-4495-84f0-31eac8ec977a service nova] Creating event network-changed:e63545f3-23e2-4661-adee-df5faf473949 for instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 on hv-cinder-85220 Aug 31 19:37:02.181416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:37:02.189650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-b503377d-e49d-4815-8758-31e8c695b19a req-64567f33-7005-4495-84f0-31eac8ec977a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056121 Aug 31 19:37:02.191380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 541/1075] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:37:02.494319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a02d59f3-0aea-46b1-bea5-38142db89044 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 204 len: 0 microversion: 2.1 time: 0.370291 Aug 31 19:37:02.504896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 535/1076] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:37:02 2022] DELETE /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:37:02.506900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:02.507605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:02.534126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.537732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.538229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.539013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:02.539485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:02.539917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:02.712802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:02.722233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0c370fc8-283e-42fa-a1dd-0c43c4a7155c tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1574 microversion: 2.1 time: 0.219792 Aug 31 19:37:02.723183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 542/1077] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:02 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:03.758581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:03.759320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:03.767824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:03.768634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:03.769294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:03.770437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:03.771302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:03.771835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:03.988229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:03.999504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-aed77101-0c44-4728-9673-d9b132747104 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1456 microversion: 2.1 time: 0.245290 Aug 31 19:37:04.002525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 536/1078] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:03 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1456 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:04.376796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-bfc13b29-1da8-44bf-a892-7435d99a8d7a req-16bcfcf4-7feb-4bbd-a6f4-d4f9a4c0b522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b1b1d14-7d79-404f-865d-c089acfe0f07", "name": "network-vif-deleted", "tag": "e63545f3-23e2-4661-adee-df5faf473949"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:04.387654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-bfc13b29-1da8-44bf-a892-7435d99a8d7a req-16bcfcf4-7feb-4bbd-a6f4-d4f9a4c0b522 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:04.388816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-bfc13b29-1da8-44bf-a892-7435d99a8d7a req-16bcfcf4-7feb-4bbd-a6f4-d4f9a4c0b522 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:04.392116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-bfc13b29-1da8-44bf-a892-7435d99a8d7a req-16bcfcf4-7feb-4bbd-a6f4-d4f9a4c0b522 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:04.406518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-bfc13b29-1da8-44bf-a892-7435d99a8d7a req-16bcfcf4-7feb-4bbd-a6f4-d4f9a4c0b522 service nova] Creating event network-vif-deleted:e63545f3-23e2-4661-adee-df5faf473949 for instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 on hv-cinder-85220 Aug 31 19:37:04.415182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-bfc13b29-1da8-44bf-a892-7435d99a8d7a req-16bcfcf4-7feb-4bbd-a6f4-d4f9a4c0b522 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040458 Aug 31 19:37:04.415182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 543/1079] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:37:05.023905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:05.024606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:05.031732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:05.032229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:05.032887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:05.033602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:05.034061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:05.034677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:05.102860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be55f0bb21f044b0a8346cf953b1650e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8bfa72ff61547e5a3097e5b40483f8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:05.111167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cc302483-f134-49e3-828e-315b997dac9a tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 200 len: 1224 microversion: 2.1 time: 0.093099 Aug 31 19:37:05.111911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 537/1080] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:05 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:06.134091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:06.134793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: 9b1b1d14-7d79-404f-865d-c089acfe0f07] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:06.141941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.142550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.143024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.143722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.144177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.144602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.158377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] HTTP exception thrown: Instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 could not be found. Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Request method failure captured: Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 HTTP/1.1 Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7YCfQ5V5_DHt2fXjpw2aefUmJUuwo2COV0-JW1B92ifUamKr3NY58yr97i-qKBGt_y2QME6B6zoqOLYfIIUSp7HJlswiKBkzOpqtuHtb4fkmsqBnO_K88xcE-vdzVfmLr4LIgl1biaqamhBIa03EMZWm5cO1PW87J0Cy1fWZGjfvbY Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:37:06.160030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8bfa72ff61547e5a3097e5b40483f8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: be55f0bb21f044b0a8346cf953b1650e Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 could not be found. Aug 31 19:37:06.161684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '9b1b1d14-7d79-404f-865d-c089acfe0f07'} Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 could not be found. Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:37:06.162618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 could not be found. Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 could not be found. Aug 31 19:37:06.164248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.165748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Returning 404 to user: Instance 9b1b1d14-7d79-404f-865d-c089acfe0f07 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:37:06.165748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-649b5889-e779-4eb6-87be-e73aab8ad431 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07" status: 404 len: 111 microversion: 2.1 time: 0.031586 Aug 31 19:37:06.165748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 544/1081] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:06 2022] GET /compute/v2.1/servers/9b1b1d14-7d79-404f-865d-c089acfe0f07 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:37:06.670365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:06.670962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:06.677274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.677764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.678197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.678914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.679373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.679797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.694463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] HTTP exception thrown: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Request method failure captured: Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace HTTP/1.1 Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7YCfQ5V5_DHt2fXjpw2aefUmJUuwo2COV0-JW1B92ifUamKr3NY58yr97i-qKBGt_y2QME6B6zoqOLYfIIUSp7HJlswiKBkzOpqtuHtb4fkmsqBnO_K88xcE-vdzVfmLr4LIgl1biaqamhBIa03EMZWm5cO1PW87J0Cy1fWZGjfvbY Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:37:06.696225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8bfa72ff61547e5a3097e5b40483f8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: be55f0bb21f044b0a8346cf953b1650e Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.697818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': 'dfd04ea9-23ba-4968-9801-39230f724ace'} Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:37:06.698860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.700420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.702121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Returning 404 to user: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:37:06.702121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-87735305-f3b2-4bec-aa74-5bc86d858d33 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 404 len: 111 microversion: 2.1 time: 0.031945 Aug 31 19:37:06.702121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 538/1082] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:37:06 2022] DELETE /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:37:06.707328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:06.707962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] [instance: dfd04ea9-23ba-4968-9801-39230f724ace] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:06.714130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.714623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.715102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.715830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:06.716430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:06.717087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:06.733024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] HTTP exception thrown: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Request method failure captured: Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace HTTP/1.1 Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7YCfQ5V5_DHt2fXjpw2aefUmJUuwo2COV0-JW1B92ifUamKr3NY58yr97i-qKBGt_y2QME6B6zoqOLYfIIUSp7HJlswiKBkzOpqtuHtb4fkmsqBnO_K88xcE-vdzVfmLr4LIgl1biaqamhBIa03EMZWm5cO1PW87J0Cy1fWZGjfvbY Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:37:06.734693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8bfa72ff61547e5a3097e5b40483f8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8bfa72ff61547e5a3097e5b40483f8a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: b8bfa72ff61547e5a3097e5b40483f8a Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-TestVolumeBootPattern-1396201292 Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: be55f0bb21f044b0a8346cf953b1650e Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-TestVolumeBootPattern-1396201292-project Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.736399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': 'dfd04ea9-23ba-4968-9801-39230f724ace'} Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:37:06.737322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. Aug 31 19:37:06.738687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:06.740045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Returning 404 to user: Instance dfd04ea9-23ba-4968-9801-39230f724ace could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:37:06.740045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0267e48e-df8e-4d9f-b301-cf3c8d458927 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace" status: 404 len: 111 microversion: 2.1 time: 0.033207 Aug 31 19:37:06.740045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 545/1083] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:06 2022] GET /compute/v2.1/servers/dfd04ea9-23ba-4968-9801-39230f724ace => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:37:08.136639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203798882", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "networks": [{"uuid": "da22a2dd-1d66-43c2-a218-71719ade89b7"}]}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:08.193999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] validate_networks() for [('da22a2dd-1d66-43c2-a218-71719ade89b7', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:37:08.359921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d0f78835-17b7-42b7-bbd7-4f82a23ad8c2 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] Calling method '.version_select at 0x7ff6cb630af0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:08.447549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d0f78835-17b7-42b7-bbd7-4f82a23ad8c2 tempest-TestVolumeBootPattern-1396201292 tempest-TestVolumeBootPattern-1396201292-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-667416223" status: 202 len: 0 microversion: 2.1 time: 0.092195 Aug 31 19:37:08.448138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 546/1084] 10.222.0.59 () {58 vars in 1260 bytes} [Wed Aug 31 19:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-667416223 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 19:37:08.584231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:37:08.584662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:37:08.585178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:37:08.585621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:37:08.586038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:37:08.596682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:08.597167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:08.597607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:08.598337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:08.598797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:08.599257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:08.616977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Getting quotas for project b8270db003fa4442afb38ba99ee0263e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:37:08.620920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Getting quotas for user 1d68da36768d48a2bccb0fd2fd1a7acb and project b8270db003fa4442afb38ba99ee0263e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:37:08.633995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:37:08.636339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:37:08.780838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8ea68a33-6ad1-49ee-ad63-f25ffd2aa788 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647438 Aug 31 19:37:08.787063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 539/1085] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:37:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:37:08.792817 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f01de5ce-057a-45b0-bcdf-02faf218e476 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:08.793454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f01de5ce-057a-45b0-bcdf-02faf218e476 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:08.871510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f01de5ce-057a-45b0-bcdf-02faf218e476 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:08.879284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f01de5ce-057a-45b0-bcdf-02faf218e476 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1213 microversion: 2.1 time: 0.090885 Aug 31 19:37:08.880355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 547/1086] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:08 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:09.900778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:09.901318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:09.909713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:09.910200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:09.910640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:09.911441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:09.911992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:09.912431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:09.976531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:09.984795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-54223d76-d57b-45a1-943a-e10563858d39 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1217 microversion: 2.1 time: 0.088067 Aug 31 19:37:09.985442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 540/1087] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:09 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:11.005786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:11.006368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:11.013488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:11.014056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:11.014497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:11.015226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:11.015683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:11.016115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:11.078762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:11.088580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-03faba56-92df-48fb-895f-b42ac1592870 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1217 microversion: 2.1 time: 0.086657 Aug 31 19:37:11.089355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 548/1088] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:11 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:12.109665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:12.110346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:12.116961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:12.117482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:12.117921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:12.118631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:12.119100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:12.119520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:12.215354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:12.225332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d3a91ca0-9349-4404-ad5a-59bb363b6435 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1265 microversion: 2.1 time: 0.119643 Aug 31 19:37:12.226014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 541/1089] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:12 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:13.247177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:13.248063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:13.264310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:13.265265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:13.265908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:13.266965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:13.267434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:13.269306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:13.692024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:13.701741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:13.701741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ff49e511-2819-43e2-991d-348fecb5205f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1271 microversion: 2.1 time: 0.457828 Aug 31 19:37:13.702105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 549/1090] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:13 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1271 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:14.723711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:14.724483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:14.732276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:14.732849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:14.733665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:14.734376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:14.734920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:14.735510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:14.916083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:14.922984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:14.927455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c0095760-913d-4b44-8310-ee5442af32f3 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.208352 Aug 31 19:37:14.930792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 542/1091] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:14 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:15.951291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:15.952152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:15.956351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:15.967031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:15.967975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:15.968893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:15.976791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-09b0ef30-e8c3-48e4-a163-7f48180d461c req-b080567c-3022-49aa-9224-d3f818df095f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832a1394-fd6c-49f6-9456-a7c8c120c64f", "tag": "4a35a37c-c313-4ccb-971a-1709cd92362a"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:15.981942 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:15.982666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:15.984155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:15.998061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-09b0ef30-e8c3-48e4-a163-7f48180d461c req-b080567c-3022-49aa-9224-d3f818df095f service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:15.999081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-09b0ef30-e8c3-48e4-a163-7f48180d461c req-b080567c-3022-49aa-9224-d3f818df095f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:16.000342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-09b0ef30-e8c3-48e4-a163-7f48180d461c req-b080567c-3022-49aa-9224-d3f818df095f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:16.018402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-09b0ef30-e8c3-48e4-a163-7f48180d461c req-b080567c-3022-49aa-9224-d3f818df095f service nova] Creating event network-changed:4a35a37c-c313-4ccb-971a-1709cd92362a for instance 832a1394-fd6c-49f6-9456-a7c8c120c64f on hv-cinder-85220 Aug 31 19:37:16.025271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-09b0ef30-e8c3-48e4-a163-7f48180d461c req-b080567c-3022-49aa-9224-d3f818df095f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052321 Aug 31 19:37:16.026653 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 543/1092] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:37:16.207681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:16.222652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-48403d06-b1e1-4bb8-b8e0-3a0b0db0789d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.277418 Aug 31 19:37:16.224346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 550/1093] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:15 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:37:17.247113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:17.247853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:17.249852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:17.255265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:17.255990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:17.256429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:17.257136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:17.257593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:17.258022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:17.423157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:17.427902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b5438bbc-8417-499b-a039-912d395582e4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.186152 Aug 31 19:37:17.428638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 544/1094] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:17 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:18.449844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:18.451073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:18.458814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:18.459319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:18.459751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:18.460457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:18.460908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:18.461354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:18.594220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:18.602398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7730975a-7c95-44e7-b1a5-eb1fcdfd3190 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.157109 Aug 31 19:37:18.603010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 551/1095] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:18 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:19.624305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:19.624918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:19.627415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:19.628085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:19.633159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:19.633653 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:19.634096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:19.634800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:19.635456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:19.635887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:19.796133 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:19.803891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9a12b679-5c2f-47d4-b935-1156db2a52af tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.184283 Aug 31 19:37:19.804460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 545/1096] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:19 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:20.828459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:20.829077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:20.831684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:20.837520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:20.838291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:20.838696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:20.839261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:20.844820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:20.844820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:20.978830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:20.987368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-80ba07c0-ce50-46cc-a190-60fb4afbd1c2 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.163146 Aug 31 19:37:20.987940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 552/1097] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:20 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:22.009234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:22.009883 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:22.017421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:22.019136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:22.019136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:22.019136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:22.019572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:22.020008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:22.157019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:22.163095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5009f183-6b63-4a08-a11a-6e2e2e68bae5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.157757 Aug 31 19:37:22.163679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 546/1098] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:22 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:22.386444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-622b8a32-8842-4189-add6-03f01c2e9b6e req-44090aab-ca32-447f-bb27-db9385161cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832a1394-fd6c-49f6-9456-a7c8c120c64f", "name": "network-vif-plugged", "status": "completed", "tag": "4a35a37c-c313-4ccb-971a-1709cd92362a"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:22.397750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-622b8a32-8842-4189-add6-03f01c2e9b6e req-44090aab-ca32-447f-bb27-db9385161cfb service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:22.398284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-622b8a32-8842-4189-add6-03f01c2e9b6e req-44090aab-ca32-447f-bb27-db9385161cfb service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:22.398722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-622b8a32-8842-4189-add6-03f01c2e9b6e req-44090aab-ca32-447f-bb27-db9385161cfb service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:22.410303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-622b8a32-8842-4189-add6-03f01c2e9b6e req-44090aab-ca32-447f-bb27-db9385161cfb service nova] Creating event network-vif-plugged:4a35a37c-c313-4ccb-971a-1709cd92362a for instance 832a1394-fd6c-49f6-9456-a7c8c120c64f on hv-cinder-85220 Aug 31 19:37:22.415348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-622b8a32-8842-4189-add6-03f01c2e9b6e req-44090aab-ca32-447f-bb27-db9385161cfb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219682 Aug 31 19:37:22.415943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 553/1099] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:37:23.183341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:23.184008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:23.191049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:23.191531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:23.192107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:23.192682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:23.193134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:23.193557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:23.328821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:23.336965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6167ec2b-a155-4a9d-abb2-c75c2e0d54a9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.157539 Aug 31 19:37:23.337529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 547/1100] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:23 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:24.360864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:24.361604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:24.368078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:24.368581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:24.369040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:24.369747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:24.370209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:24.370643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:24.518221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:24.526098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bd1f66a0-96f3-4eb9-b605-3b35f4ec80d6 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1313 microversion: 2.1 time: 0.170091 Aug 31 19:37:24.526664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 554/1101] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:24 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:25.548514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:25.549066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:25.555183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:25.555676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:25.556116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:25.556904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:25.557385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:25.557893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:25.694303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:25.703075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-21cac1fc-3bd1-45c8-8d9a-5d22894f1fb4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1497 microversion: 2.1 time: 0.159172 Aug 31 19:37:25.703650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 548/1102] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:25 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:26.765043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:26.765687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:26.772643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:26.773134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:26.775090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:26.775090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:26.775090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:26.775387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:26.809039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:37:27.217756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04433281-13a1-42b9-aa8e-13000b065d0f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "DELETE /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 204 len: 0 microversion: 2.1 time: 0.456496 Aug 31 19:37:27.218469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 555/1103] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:37:26 2022] DELETE /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:37:27.226625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:27.227276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:27.234516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:27.235050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:27.235520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:27.236333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:27.236825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:27.237260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:27.370107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:27.379412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3c4478c1-2787-4cf6-8f95-295cc06e378f tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1503 microversion: 2.1 time: 0.156620 Aug 31 19:37:27.379983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 549/1104] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:27 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:28.402369 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:28.403029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:28.409867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:28.413347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:28.413347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:28.413347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:28.413347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:28.413715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:28.544936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:28.553259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a6d6aed7-404f-445e-982b-881887812619 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1503 microversion: 2.1 time: 0.155271 Aug 31 19:37:28.553837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 556/1105] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:28 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:29.575495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:29.576086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:29.583646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:29.584134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:29.584652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:29.585359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:29.585817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:29.586242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:29.734779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:29.737890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-4928eb06-891d-4ded-87a8-418ecea28fd5 req-4c2e756d-e672-427d-b8e2-0f4916d6ac01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832a1394-fd6c-49f6-9456-a7c8c120c64f", "name": "network-vif-deleted", "tag": "4a35a37c-c313-4ccb-971a-1709cd92362a"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:29.742784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e2634cd2-9950-416a-a878-7d608a0633e0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1503 microversion: 2.1 time: 0.171245 Aug 31 19:37:29.743476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 550/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:29 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:29.753816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-4928eb06-891d-4ded-87a8-418ecea28fd5 req-4c2e756d-e672-427d-b8e2-0f4916d6ac01 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:29.754418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-4928eb06-891d-4ded-87a8-418ecea28fd5 req-4c2e756d-e672-427d-b8e2-0f4916d6ac01 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:29.754983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-4928eb06-891d-4ded-87a8-418ecea28fd5 req-4c2e756d-e672-427d-b8e2-0f4916d6ac01 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:29.774272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-4928eb06-891d-4ded-87a8-418ecea28fd5 req-4c2e756d-e672-427d-b8e2-0f4916d6ac01 service nova] Creating event network-vif-deleted:4a35a37c-c313-4ccb-971a-1709cd92362a for instance 832a1394-fd6c-49f6-9456-a7c8c120c64f on hv-cinder-85220 Aug 31 19:37:29.779220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-4928eb06-891d-4ded-87a8-418ecea28fd5 req-4c2e756d-e672-427d-b8e2-0f4916d6ac01 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045446 Aug 31 19:37:29.779929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 557/1107] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:37:30.765046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:30.765700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:30.772266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:30.772750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:30.773191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:30.773889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:30.774347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:30.774774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:30.806912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:30.807407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:30.807852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:30.808306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lazy-loading 'fault' on Instance uuid 832a1394-fd6c-49f6-9456-a7c8c120c64f {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:37:30.851502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:30.859751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-160e854c-c262-4e0e-9d3e-5c95b418a740 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 200 len: 1303 microversion: 2.1 time: 0.099257 Aug 31 19:37:30.860337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 551/1108] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:30 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:31.878778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:37:31.879373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:37:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f (ip 10.222.0.59) !!! Aug 31 19:37:31.884476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:31.885176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 832a1394-fd6c-49f6-9456-a7c8c120c64f] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:31.893065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:31.893552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:31.894014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:31.894937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:31.895548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:31.895974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:31.910742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] HTTP exception thrown: Instance 832a1394-fd6c-49f6-9456-a7c8c120c64f could not be found. Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Request method failure captured: Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f HTTP/1.1 Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7hglVfZScnNpt4dLFqdCdWbqTEl_oOY_hOZ7UMbQxiOeUdf_oXgUqZyJNG7d2wFid_2fYopJ9T1bCTTWsOye78iqRBOwCtH3yq1UccdIIXcmn9dlVVft_MrxjgpE_ww8wcs6Fktu_lVGzHaKutXTCgR2idlqC_dp5kWK8AoFR2TZoQ Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: b8270db003fa4442afb38ba99ee0263e Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-VolumesActionsTest-1900852958 Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:37:31.912429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8270db003fa4442afb38ba99ee0263e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8270db003fa4442afb38ba99ee0263e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8270db003fa4442afb38ba99ee0263e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8270db003fa4442afb38ba99ee0263e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-VolumesActionsTest-1900852958 Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: b8270db003fa4442afb38ba99ee0263e Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-VolumesActionsTest-1900852958 Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-VolumesActionsTest-1900852958-project Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 1d68da36768d48a2bccb0fd2fd1a7acb Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-VolumesActionsTest-1900852958-project Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 832a1394-fd6c-49f6-9456-a7c8c120c64f could not be found. Aug 31 19:37:31.914222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '832a1394-fd6c-49f6-9456-a7c8c120c64f'} Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 832a1394-fd6c-49f6-9456-a7c8c120c64f could not be found. Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:37:31.915418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 832a1394-fd6c-49f6-9456-a7c8c120c64f could not be found. Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 832a1394-fd6c-49f6-9456-a7c8c120c64f could not be found. Aug 31 19:37:31.917083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:37:31.918659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Returning 404 to user: Instance 832a1394-fd6c-49f6-9456-a7c8c120c64f could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:37:31.918659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4884e034-a3cf-40e0-b05d-a3319f505ef9 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f" status: 404 len: 111 microversion: 2.1 time: 0.036221 Aug 31 19:37:31.918659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 558/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:31 2022] GET /compute/v2.1/servers/832a1394-fd6c-49f6-9456-a7c8c120c64f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:37:32.020813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1704219165", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "networks": [{"uuid": "da22a2dd-1d66-43c2-a218-71719ade89b7"}]}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:32.082507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] validate_networks() for [('da22a2dd-1d66-43c2-a218-71719ade89b7', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:37:32.492952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:37:32.493419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:37:32.493895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:37:32.494361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:37:32.494804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:37:32.505353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:32.505937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:32.506311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:32.507105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:32.507572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:32.508007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:32.527228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Getting quotas for project b8270db003fa4442afb38ba99ee0263e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:37:32.531110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Getting quotas for user 1d68da36768d48a2bccb0fd2fd1a7acb and project b8270db003fa4442afb38ba99ee0263e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:37:32.543778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:37:32.546918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:37:32.685292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7cd042f5-7479-4986-a26a-72eaa8593eae tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661458 Aug 31 19:37:32.685292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 552/1110] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:37:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:37:32.688996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cf1ceff5-f513-465a-b5fb-21f393423432 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:32.689624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cf1ceff5-f513-465a-b5fb-21f393423432 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:32.753000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cf1ceff5-f513-465a-b5fb-21f393423432 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:32.762640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cf1ceff5-f513-465a-b5fb-21f393423432 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1214 microversion: 2.1 time: 0.077720 Aug 31 19:37:32.763385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 559/1111] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:32 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:33.785658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:33.786258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:33.793516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:33.794008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:33.794457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:33.795185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:33.795650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:33.796083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:33.856844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:33.865099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-75324e15-8680-4c10-84c8-96fc8a95ff6a tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1218 microversion: 2.1 time: 0.083328 Aug 31 19:37:33.865875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 553/1112] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:33 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:34.886380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:34.887045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:34.895206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:34.895696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:34.896137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:34.896841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:34.897303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:34.897737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:34.959050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:34.966728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-db65389b-e60a-485a-9acf-7d6cd6ad4d30 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1218 microversion: 2.1 time: 0.084228 Aug 31 19:37:34.967323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 560/1113] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:34 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:35.987516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:35.988064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:35.994569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:35.995096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:35.995542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:35.996249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:35.996709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:35.997137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:36.062079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:36.070577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ccbe310f-608a-474a-a5e7-79223a4d3b54 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1218 microversion: 2.1 time: 0.088038 Aug 31 19:37:36.071171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 554/1114] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:35 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:37.091325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:37.091931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:37.098606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:37.099136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:37.099570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:37.100275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:37.100850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:37.101318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:37.173863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:37.181638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-31c7e07e-4b1f-48c7-8bc2-2200e6be26ed tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1266 microversion: 2.1 time: 0.094170 Aug 31 19:37:37.182204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 561/1115] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:37 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:38.204274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:38.204894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:38.211582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:38.212060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:38.212494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:38.213190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:38.213644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:38.214065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:38.278854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:38.287595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-429d7956-782c-4303-b433-3d4f5c96b0a1 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1266 microversion: 2.1 time: 0.087771 Aug 31 19:37:38.288175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 555/1116] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:38 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:39.308382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:39.309027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:39.315656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:39.316136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:39.316572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:39.317335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:39.317790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:39.318217 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:39.387237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:39.395385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7da5d563-9531-409d-a5c2-8f79b2063686 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1266 microversion: 2.1 time: 0.090930 Aug 31 19:37:39.395958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 562/1117] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:39 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:40.416745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:40.417386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:40.424527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:40.425013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:40.425452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:40.426154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:40.426612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:40.427071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:40.489925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:40.497588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a1351c4b-1f73-4678-b8cd-93c759a55056 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1266 microversion: 2.1 time: 0.084797 Aug 31 19:37:40.498149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 556/1118] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:40 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:41.518706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:41.519920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:41.526484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:41.527013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:41.527465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:41.534446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:41.534446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:41.534446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:41.595744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:41.603687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c1bad6e4-b24a-4304-a8aa-bddf97496d4e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1284 microversion: 2.1 time: 0.089152 Aug 31 19:37:41.607361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 563/1119] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:41 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:42.624994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:42.626477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:42.630398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:42.630854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:42.635970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:42.636469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:42.636909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:42.637620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:42.638263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:42.638695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:42.780329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:42.788546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eeeff79a-285b-4bed-b163-6edcec3724b0 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.167438 Aug 31 19:37:42.789825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 557/1120] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:42 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:43.075980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-b46413c2-8174-4b41-b9a9-93c7c578e533 req-d4efbae0-6400-48ed-93a4-4bdbdab35f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24", "tag": "bec73195-1bc1-45d8-b23a-d938a84794db"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:43.085272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:43.090297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b46413c2-8174-4b41-b9a9-93c7c578e533 req-d4efbae0-6400-48ed-93a4-4bdbdab35f5f service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:43.091036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b46413c2-8174-4b41-b9a9-93c7c578e533 req-d4efbae0-6400-48ed-93a4-4bdbdab35f5f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:43.091478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-b46413c2-8174-4b41-b9a9-93c7c578e533 req-d4efbae0-6400-48ed-93a4-4bdbdab35f5f service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:43.109091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-b46413c2-8174-4b41-b9a9-93c7c578e533 req-d4efbae0-6400-48ed-93a4-4bdbdab35f5f service nova] Creating event network-changed:bec73195-1bc1-45d8-b23a-d938a84794db for instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 on hv-cinder-85220 Aug 31 19:37:43.119142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-b46413c2-8174-4b41-b9a9-93c7c578e533 req-d4efbae0-6400-48ed-93a4-4bdbdab35f5f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047286 Aug 31 19:37:43.120414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 564/1121] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:37:43.809512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:43.810127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:43.817409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:43.817894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:43.818334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:43.819088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:43.819546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:43.819973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:43.957807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:43.965490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e4531ea3-ec9f-4e37-a69d-c9b3c1831352 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.159888 Aug 31 19:37:43.966156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 558/1122] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:43 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:44.987295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:44.988940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:44.995871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:44.996357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:44.996800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:44.997504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:44.997968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:44.998406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:45.132925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:45.140648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-29a6a9cb-9793-4b5b-84cb-cf1b04c9120c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.158260 Aug 31 19:37:45.141215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 565/1123] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:44 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:37:46.162303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:46.164290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:46.170076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:46.170559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:46.171090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:46.171869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:46.172386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:46.172828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:46.316870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:46.325336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7abb0840-679d-4ab6-aaa7-ca89bdb52894 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.167497 Aug 31 19:37:46.325903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 559/1124] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:46 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:47.347702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:47.348505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:47.355523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:47.355689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:47.356052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:47.356748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:47.357213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:47.357651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:47.505187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:47.517945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c5fbd0fe-7166-49ef-8af3-d399ca46f025 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.174242 Aug 31 19:37:47.519736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 566/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:47 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:48.541125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:48.541687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:48.548360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:48.548842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:48.549280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:48.549993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:48.550613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:48.551237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:48.553874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=97 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:48.698773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:48.707503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-42df132c-d7c9-47ce-ad70-acb28a75ae1c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.170312 Aug 31 19:37:48.708160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 560/1126] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:48 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:49.729297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:49.730031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:49.737594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:49.738829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:49.739329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:49.740045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:49.740559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:49.740930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:49.745182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:49.876785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:49.886150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c5bcc9fa-abd5-4036-ad71-ff64f9e7250b tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.160864 Aug 31 19:37:49.886912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 567/1127] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:49 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:50.324851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-9a4fe153-f9ec-436d-b9ca-127c9bbae41d req-fac34698-d265-4325-ad1b-2567b54363b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24", "name": "network-vif-plugged", "status": "completed", "tag": "bec73195-1bc1-45d8-b23a-d938a84794db"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:37:50.335990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9a4fe153-f9ec-436d-b9ca-127c9bbae41d req-fac34698-d265-4325-ad1b-2567b54363b5 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:50.336478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9a4fe153-f9ec-436d-b9ca-127c9bbae41d req-fac34698-d265-4325-ad1b-2567b54363b5 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:50.336914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9a4fe153-f9ec-436d-b9ca-127c9bbae41d req-fac34698-d265-4325-ad1b-2567b54363b5 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:50.350863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-9a4fe153-f9ec-436d-b9ca-127c9bbae41d req-fac34698-d265-4325-ad1b-2567b54363b5 service nova] Creating event network-vif-plugged:bec73195-1bc1-45d8-b23a-d938a84794db for instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 on hv-cinder-85220 Aug 31 19:37:50.356606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-9a4fe153-f9ec-436d-b9ca-127c9bbae41d req-fac34698-d265-4325-ad1b-2567b54363b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034902 Aug 31 19:37:50.356992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 561/1128] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:37:50.906901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:50.907530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:50.909860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:50.914607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:50.915121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:50.915561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:50.916258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:50.916725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:50.917154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:51.052187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:51.060220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0fdb659b-ac2d-42cc-a018-b419e0056ac5 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.157497 Aug 31 19:37:51.060792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 568/1129] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:50 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:52.084250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:52.084943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:52.091199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:52.091681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:52.092117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:52.092809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:52.093260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:52.093686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:52.222721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:52.230296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a98d5708-3c22-494c-beb2-30f0bcf7a24d tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1314 microversion: 2.1 time: 0.151976 Aug 31 19:37:52.230857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 562/1130] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:52 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:37:53.252023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:53.252644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:53.259287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:53.259841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:53.260239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:53.260936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:53.261399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:53.261840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:53.406282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:53.415692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d3744504-6a10-4067-8a96-c44d142cf94e tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1498 microversion: 2.1 time: 0.167661 Aug 31 19:37:53.416285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 569/1131] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:53 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:57.977455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:57.978007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:57.980548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:37:57.985140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:57.985625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:57.986066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:57.986754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:57.987235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:57.988451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:58.014438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:37:58.337406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6431e58e-4ff5-446a-aca5-51f3357dbb28 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 204 len: 0 microversion: 2.1 time: 0.363496 Aug 31 19:37:58.337998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 563/1132] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:37:57 2022] DELETE /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:37:58.346247 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:58.347052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:58.354362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:58.354849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:58.355302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:58.356007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:58.356463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:58.356919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:58.498754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:58.506712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-293bd515-98ec-4cc1-be72-a9e40fdaa6a7 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1504 microversion: 2.1 time: 0.164320 Aug 31 19:37:58.507312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 570/1133] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:58 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:37:59.529259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:37:59.529879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:37:59.537024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:59.537508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:59.537953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:59.538654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:37:59.539146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:37:59.539592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:37:59.675771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:37:59.683808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8852d58f-3027-42dd-bc89-5926f71b6dc4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1504 microversion: 2.1 time: 0.158852 Aug 31 19:37:59.684395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 564/1134] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:37:59 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:00.704392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:00.704985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:00.712556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:00.713227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:00.713681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:00.714399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:00.714886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:00.715338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:00.805558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:00.817320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2f266057-dfb6-43b2-8228-e4828527bb9c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1462 microversion: 2.1 time: 0.116815 Aug 31 19:38:00.831941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 571/1135] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:00 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:00.873419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-b1890e28-37fb-429b-8b0d-e3aa336d43af req-c601c671-c4b2-4a3d-a296-cbd4e05c35db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24", "name": "network-vif-deleted", "tag": "bec73195-1bc1-45d8-b23a-d938a84794db"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:00.884513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b1890e28-37fb-429b-8b0d-e3aa336d43af req-c601c671-c4b2-4a3d-a296-cbd4e05c35db service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:00.887003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b1890e28-37fb-429b-8b0d-e3aa336d43af req-c601c671-c4b2-4a3d-a296-cbd4e05c35db service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:00.887003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b1890e28-37fb-429b-8b0d-e3aa336d43af req-c601c671-c4b2-4a3d-a296-cbd4e05c35db service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:00.897122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-b1890e28-37fb-429b-8b0d-e3aa336d43af req-c601c671-c4b2-4a3d-a296-cbd4e05c35db service nova] Creating event network-vif-deleted:bec73195-1bc1-45d8-b23a-d938a84794db for instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 on hv-cinder-85220 Aug 31 19:38:00.902042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-b1890e28-37fb-429b-8b0d-e3aa336d43af req-c601c671-c4b2-4a3d-a296-cbd4e05c35db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032453 Aug 31 19:38:00.902676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 565/1136] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:01.838308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:01.845401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:01.845401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:01.845798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:01.846231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:01.847064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:01.847526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:01.847954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:01.880540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:01.881034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:01.881565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:01.882061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lazy-loading 'fault' on Instance uuid 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:38:01.928724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d68da36768d48a2bccb0fd2fd1a7acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8270db003fa4442afb38ba99ee0263e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:01.936933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2cf7b890-a059-4123-84a9-4a313f852a8c tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 200 len: 1304 microversion: 2.1 time: 0.102365 Aug 31 19:38:01.937751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 572/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:01 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:02.960981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:02.961696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] [instance: 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:02.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:02.968909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:02.969343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:02.970032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:02.970490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:02.970995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:02.985446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] HTTP exception thrown: Instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 could not be found. Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Request method failure captured: Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 HTTP/1.1 Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7hglVfZScnNpt4dLFqdCdWbqTEl_oOY_hOZ7UMbQxiOeUdf_oXgUqZyJNG7d2wFid_2fYopJ9T1bCTTWsOye78iqRBOwCtH3yq1UccdIIXcmn9dlVVft_MrxjgpE_ww8wcs6Fktu_lVGzHaKutXTCgR2idlqC_dp5kWK8AoFR2TZoQ Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: b8270db003fa4442afb38ba99ee0263e Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-VolumesActionsTest-1900852958 Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:38:02.987140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8270db003fa4442afb38ba99ee0263e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b8270db003fa4442afb38ba99ee0263e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b8270db003fa4442afb38ba99ee0263e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b8270db003fa4442afb38ba99ee0263e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-VolumesActionsTest-1900852958 Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: b8270db003fa4442afb38ba99ee0263e Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-VolumesActionsTest-1900852958 Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-VolumesActionsTest-1900852958-project Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 1d68da36768d48a2bccb0fd2fd1a7acb Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-VolumesActionsTest-1900852958-project Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 could not be found. Aug 31 19:38:02.989214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24'} Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 could not be found. Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:38:02.990052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 could not be found. Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 could not be found. Aug 31 19:38:02.991427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:02.992616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] Returning 404 to user: Instance 8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:38:02.992616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-60cd32fb-da9b-4d87-924f-b19b7f37d9f4 tempest-VolumesActionsTest-1900852958 tempest-VolumesActionsTest-1900852958-project] 10.222.0.59 "GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24" status: 404 len: 111 microversion: 2.1 time: 0.033314 Aug 31 19:38:02.992616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 566/1138] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:02 2022] GET /compute/v2.1/servers/8bf73afd-ff31-49cd-a6f8-0b8a3d39bc24 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:38:04.339258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:04.339786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:04.346740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.347663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.348079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.348800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.349269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.349707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.373981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-25a16f42-97e1-4515-923a-3f735c59dc50 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/ips" status: 200 len: 150 microversion: 2.1 time: 0.418185 Aug 31 19:38:04.381515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 573/1139] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:38:03 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/ips => generated 150 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:04.386927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62679355-12d0-450d-80c2-480b6ee72e62"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:04.389816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:04.397568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.401030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.401030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.401030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.401030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.401420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.485622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Invalid volume: volume 62679355-12d0-450d-80c2-480b6ee72e62 is already attached to instances: 952eb54c-5683-4fdf-ad61-7564b9dafbb5 Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: POST /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/os-volume_attachments HTTP/1.1 Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 74 Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:38:04.487270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {"volumeAttachment": {"volumeId": "62679355-12d0-450d-80c2-480b6ee72e62"}} Aug 31 19:38:04.489195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Invalid volume: volume 62679355-12d0-450d-80c2-480b6ee72e62 is already attached to instances: 952eb54c-5683-4fdf-ad61-7564b9dafbb5 Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'server_id': '9e12e83c-b998-423b-a10f-ca1d120457c5', 'body': {'volumeAttachment': {'volumeId': '62679355-12d0-450d-80c2-480b6ee72e62'}}} Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 62679355-12d0-450d-80c2-480b6ee72e62 is already attached to instances: 952eb54c-5683-4fdf-ad61-7564b9dafbb5 Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:04.490059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 62679355-12d0-450d-80c2-480b6ee72e62 is already attached to instances: 952eb54c-5683-4fdf-ad61-7564b9dafbb5 Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:04.491352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 62679355-12d0-450d-80c2-480b6ee72e62 is already attached to instances: 952eb54c-5683-4fdf-ad61-7564b9dafbb5 Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 400 to user: Invalid volume: volume 62679355-12d0-450d-80c2-480b6ee72e62 is already attached to instances: 952eb54c-5683-4fdf-ad61-7564b9dafbb5 {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-60516c1b-adbc-41e6-9021-a0c12568660f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105997 Aug 31 19:38:04.492716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 567/1140] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:38:04 2022] POST /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:38:04.497739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:04.498726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:04.504432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.505024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.505476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.506184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.506727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.507120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.533775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Going to try to terminate instance {{(pid=121187) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:38:04.822136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b9956c86-1e03-4af0-aa12-738c1a2c200f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 204 len: 0 microversion: 2.1 time: 0.328074 Aug 31 19:38:04.825395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 574/1141] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:38:04 2022] DELETE /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:38:04.831843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:04.833204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:04.839845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.840330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.840806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.841507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:04.842009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:04.842444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:04.977470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:04.985254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6447c98b-4385-4a31-9e11-7051ed10f5f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1682 microversion: 2.1 time: 0.157758 Aug 31 19:38:04.985822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 568/1142] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:04 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:06.007941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:06.008743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:06.015169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:06.015678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:06.016121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:06.016828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:06.017289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:06.017724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:06.157211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:06.165534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67bc7505-9f1d-4de0-aab8-aa9fede9f034 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1682 microversion: 2.1 time: 0.161995 Aug 31 19:38:06.166068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 575/1143] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:06 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:07.187491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:07.188112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:07.195164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:07.195589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:07.196060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:07.196987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:07.197450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:07.197934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:07.336939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:07.344672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f1b53112-cab8-498c-a60d-eb48a03b9671 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1682 microversion: 2.1 time: 0.161589 Aug 31 19:38:07.345242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 569/1144] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:07 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:08.365923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:08.366634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:08.373265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:08.373747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:08.374188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:08.374892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:08.375377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:08.375797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:08.507511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:08.515653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fafc95d9-4f65-4dc4-a283-16f3b4b1f11d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1682 microversion: 2.1 time: 0.153994 Aug 31 19:38:08.516480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 576/1145] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:08 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:09.537949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:09.539464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:09.549218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:09.549712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:09.550152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:09.551051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:09.551506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:09.551931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:09.692860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:09.700803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c27fb4cb-08fd-4162-b9f2-64500b6a08a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1682 microversion: 2.1 time: 0.167149 Aug 31 19:38:09.701384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 570/1146] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:09 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:10.725926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:10.727155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:10.735064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:10.735851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:10.736452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:10.737344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:10.738124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:10.741847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:11.315770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:11.333539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d9cd7f93-7207-4e4a-a85e-ffd6af7c8e1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1614 microversion: 2.1 time: 0.611543 Aug 31 19:38:11.336310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 577/1147] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:10 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1614 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:11.368428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-d0d87a80-d95f-48a9-8959-fdad4f812a4f req-992eecf2-1274-41b5-8cc9-47373ba0c3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e12e83c-b998-423b-a10f-ca1d120457c5", "name": "network-vif-deleted", "tag": "f06043a7-09af-4461-adf6-f90f75c82f7d"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:11.392104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-d0d87a80-d95f-48a9-8959-fdad4f812a4f req-992eecf2-1274-41b5-8cc9-47373ba0c3e1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:11.392893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-d0d87a80-d95f-48a9-8959-fdad4f812a4f req-992eecf2-1274-41b5-8cc9-47373ba0c3e1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:11.393464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-d0d87a80-d95f-48a9-8959-fdad4f812a4f req-992eecf2-1274-41b5-8cc9-47373ba0c3e1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:11.417489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-d0d87a80-d95f-48a9-8959-fdad4f812a4f req-992eecf2-1274-41b5-8cc9-47373ba0c3e1 service nova] Creating event network-vif-deleted:f06043a7-09af-4461-adf6-f90f75c82f7d for instance 9e12e83c-b998-423b-a10f-ca1d120457c5 on hv-cinder-85220 Aug 31 19:38:11.437987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-d0d87a80-d95f-48a9-8959-fdad4f812a4f req-992eecf2-1274-41b5-8cc9-47373ba0c3e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072748 Aug 31 19:38:11.439704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 571/1148] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:12.361095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:12.362271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:12.391287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:12.392182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:12.392780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:12.396864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:12.398547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:12.400346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:12.439119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:12.439599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:12.440214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:12.440867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lazy-loading 'fault' on Instance uuid 9e12e83c-b998-423b-a10f-ca1d120457c5 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:38:12.497389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:12.510291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-415c33c0-d6ba-4255-86bd-d3197810db12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 200 len: 1331 microversion: 2.1 time: 0.151240 Aug 31 19:38:12.511173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 578/1149] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:12 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:13.534753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:13.536644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:13.544194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:13.545100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:13.545855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:13.546751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:13.547384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:13.547901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:13.568429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 HTTP/1.1 Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:38:13.571098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 19:38:13.573341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '9e12e83c-b998-423b-a10f-ca1d120457c5'} Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:38:13.574479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 19:38:13.576532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:13.578131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:38:13.578131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09e5c8a2-7478-4f20-968c-3b982bcf9ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 404 len: 111 microversion: 2.1 time: 0.045117 Aug 31 19:38:13.581663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 572/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:13 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 19:38:13.588447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6052377f-340a-48c3-bbc5-1ee70bb64cb7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '.version_select at 0x7ff6cb6019d0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:13.728116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6052377f-340a-48c3-bbc5-1ee70bb64cb7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-322373819" status: 202 len: 0 microversion: 2.1 time: 0.146773 Aug 31 19:38:13.730886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 579/1151] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 31 19:38:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-322373819 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:38:15.093810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:15.094683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:15.112792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:15.113354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:15.114375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:15.116976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:15.116976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:15.116976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:15.217224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lazy-loading 'services' on Instance uuid 952eb54c-5683-4fdf-ad61-7564b9dafbb5 {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:38:15.413159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fda8ad71-9499-4849-9f06-0468bf6af202 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments/62679355-12d0-450d-80c2-480b6ee72e62" status: 202 len: 0 microversion: 2.1 time: 0.322207 Aug 31 19:38:15.414236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 573/1152] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:38:15 2022] DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments/62679355-12d0-450d-80c2-480b6ee72e62 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:38:15.423517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:15.425874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:15.438927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:15.439770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:15.440291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:15.441110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:15.441766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:15.442678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:15.476999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c60161fb-7393-4458-928f-9e61440afdf4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058165 Aug 31 19:38:15.478212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 580/1153] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:38:15 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:16.490707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:16.493950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:16.502700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:16.502700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:16.502700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:16.503396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:16.503987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:16.504677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:16.539692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a787c0cb-39ef-4f92-bb3d-379be236e667 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053521 Aug 31 19:38:16.540626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 574/1154] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:38:16 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:17.553809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:17.556283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:17.577820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:17.578318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:17.581832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:17.581832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:17.581832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:17.581832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:17.612412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-58758ac2-40bb-4c5b-9599-64edeed9dfaf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063479 Aug 31 19:38:17.613006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 581/1155] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:38:17 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 19:38:17.690365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:17.690906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:17.698533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:17.699336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:17.699807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:17.700419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:17.700886 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:17.701322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:17.733365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:38:17.999185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-efcf9e6d-6445-4d81-a4f4-bb2100d40ed2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 204 len: 0 microversion: 2.1 time: 0.312535 Aug 31 19:38:18.000685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 575/1156] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:38:17 2022] DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:38:18.010641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:18.012205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:18.023671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:18.027065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:18.031126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:18.031126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:18.032036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:18.032681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:18.233768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:18.236978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:18.246168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-57373c17-9853-4275-9d9c-0907aa9e7139 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1679 microversion: 2.1 time: 0.240392 Aug 31 19:38:18.247238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 582/1157] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:18 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:19.273586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:19.274052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:19.280945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:19.281435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:19.282065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:19.282774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:19.283421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:19.286173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:19.289114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:19.464424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:19.474492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ed14b9ae-9832-4fb4-b5b0-8a1ac59d0bf8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1679 microversion: 2.1 time: 0.205912 Aug 31 19:38:19.483643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 576/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:19 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:38:20.514209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:20.514834 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:20.523020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:20.523588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:20.524107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:20.524938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:20.525449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:20.526052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:20.708623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:20.708623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-888a37ff-18d9-434c-abf6-4ca12a972707 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1612 microversion: 2.1 time: 0.102679 Aug 31 19:38:20.708623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 583/1159] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:20 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1612 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:20.917185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-94e1832a-a9e3-48cf-95ac-e9bb8966ad94 req-6fba9766-949b-4bf6-bcda-76fdaa6f4a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "952eb54c-5683-4fdf-ad61-7564b9dafbb5", "name": "network-vif-deleted", "tag": "347cb772-84b0-4f57-ae0d-400895cb5c95"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:20.940005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-94e1832a-a9e3-48cf-95ac-e9bb8966ad94 req-6fba9766-949b-4bf6-bcda-76fdaa6f4a29 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:20.940642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-94e1832a-a9e3-48cf-95ac-e9bb8966ad94 req-6fba9766-949b-4bf6-bcda-76fdaa6f4a29 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:20.941192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-94e1832a-a9e3-48cf-95ac-e9bb8966ad94 req-6fba9766-949b-4bf6-bcda-76fdaa6f4a29 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:20.957173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-94e1832a-a9e3-48cf-95ac-e9bb8966ad94 req-6fba9766-949b-4bf6-bcda-76fdaa6f4a29 service nova] Creating event network-vif-deleted:347cb772-84b0-4f57-ae0d-400895cb5c95 for instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 on hv-cinder-85220 Aug 31 19:38:20.963779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-94e1832a-a9e3-48cf-95ac-e9bb8966ad94 req-6fba9766-949b-4bf6-bcda-76fdaa6f4a29 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050946 Aug 31 19:38:20.968669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 577/1160] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:38:21.732565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:21.733806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:21.747085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:21.753854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:21.755200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:21.755811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:21.756965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:21.757635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:21.758220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:21.809256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:21.809804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:21.814336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:21.814336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lazy-loading 'fault' on Instance uuid 952eb54c-5683-4fdf-ad61-7564b9dafbb5 {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:38:21.883100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:21.884910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-74e7d0cc-21d9-4a11-897c-915b13d2fea9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 200 len: 1330 microversion: 2.1 time: 0.158659 Aug 31 19:38:21.886372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 584/1161] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:21 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 1330 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:22.910818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:22.911627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:22.918800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:22.919574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:22.920022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:22.920736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:22.921393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:22.921677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:22.937823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 HTTP/1.1 Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 19:38:22.939941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 19:38:22.941657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '952eb54c-5683-4fdf-ad61-7564b9dafbb5'} Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:38:22.942656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 19:38:22.944056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 19:38:22.946052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:38:22.947169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8db01529-4c57-4aab-9937-63a9e9449e42 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 404 len: 111 microversion: 2.1 time: 0.041921 Aug 31 19:38:22.948260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 578/1162] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:22 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 19:38:22.962362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cb721cc9-4c05-4c85-93b6-99f4dd89cfb0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '.version_select at 0x7ff6cb59eaf0>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:23.052562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cb721cc9-4c05-4c85-93b6-99f4dd89cfb0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482102547" status: 202 len: 0 microversion: 2.1 time: 0.095052 Aug 31 19:38:23.053422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 585/1163] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 31 19:38:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482102547 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:38:24.321321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-01353e58-adc1-408e-9433-d9eb06bdd52c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: .version_select at 0x7ff6cc961820>, body: {"keypair": {"name": "tempest-keypair-967058329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1bw1wTpfOeusVLfoc7zit6rA900RqF40Dl/YQuXJ140ZmVG1QR9/HL0P+F5oqrqHI8XT/G2Deg8lUtiWn8FfgdE6tyfiJVt8env/P3L3d9fa5o9h/ZbtFyJ4PCeTJruw=="}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:24.341148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-01353e58-adc1-408e-9433-d9eb06bdd52c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:38:24.345338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-01353e58-adc1-408e-9433-d9eb06bdd52c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:38:24.453137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-01353e58-adc1-408e-9433-d9eb06bdd52c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135964 Aug 31 19:38:24.462044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 579/1164] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:38:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:27.367585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-940290950", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e"}], "security_groups": [{"name": "tempest-securitygroup--2020171962"}], "key_name": "tempest-keypair-967058329", "user_data": "}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:27.496712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] validate_networks() for [('acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:38:28.161931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:38:28.162556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:38:28.163310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:38:28.163888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:38:28.164515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:38:28.174601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:28.181328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:28.181328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:28.181328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:28.181328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:28.181765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:28.196955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:38:28.201220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:38:28.232686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:38:28.235195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:38:28.432716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3c0f9bae-ad9b-4831-a316-954d511c59a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.070273 Aug 31 19:38:28.433484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 586/1165] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:38:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:38:28.444913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bc0fb67e-d605-43a5-9215-5ba5c07c7b10 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:28.452576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bc0fb67e-d605-43a5-9215-5ba5c07c7b10 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:28.452576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:28.505921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bc0fb67e-d605-43a5-9215-5ba5c07c7b10 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:28.515644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bc0fb67e-d605-43a5-9215-5ba5c07c7b10 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1240 microversion: 2.1 time: 0.075319 Aug 31 19:38:28.516978 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 580/1166] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:29.541401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:29.541944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:29.548089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:29.548565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:29.549000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:29.549692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:29.550147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:29.550570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:29.628467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:29.639232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2b50b85f-cd8f-427f-938d-016b94b074b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1244 microversion: 2.1 time: 0.102820 Aug 31 19:38:29.640012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 587/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:30.660596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:30.661912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:30.668982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:30.669474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:30.669910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:30.670656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:30.671324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:30.671749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:30.741705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:30.750182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ab5ee3b7-67c5-45c0-b1a1-822cc77a4f52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1300 microversion: 2.1 time: 0.093412 Aug 31 19:38:30.750751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 581/1168] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:31.773578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:31.774270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:31.781511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:31.782010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:31.782458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:31.783250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:31.783714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:31.784151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:32.031015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:32.038762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b4171ed8-33a8-4610-8110-26029390f21b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.269300 Aug 31 19:38:32.040117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 588/1169] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:32.483902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-33a6eef7-cf14-45cc-82f2-7b63a1dfc9a1 req-0a18ec22-1fc7-467f-93c7-ebd94002ffce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bc06b8-f021-4ee4-ace6-d6cc9a4ac438", "tag": "18a157bb-7161-4950-9d08-e2f3979e333d"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:32.497787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-33a6eef7-cf14-45cc-82f2-7b63a1dfc9a1 req-0a18ec22-1fc7-467f-93c7-ebd94002ffce service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:32.498411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-33a6eef7-cf14-45cc-82f2-7b63a1dfc9a1 req-0a18ec22-1fc7-467f-93c7-ebd94002ffce service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:32.499382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-33a6eef7-cf14-45cc-82f2-7b63a1dfc9a1 req-0a18ec22-1fc7-467f-93c7-ebd94002ffce service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:32.513971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-33a6eef7-cf14-45cc-82f2-7b63a1dfc9a1 req-0a18ec22-1fc7-467f-93c7-ebd94002ffce service nova] Creating event network-changed:18a157bb-7161-4950-9d08-e2f3979e333d for instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 on hv-cinder-85220 Aug 31 19:38:32.519463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-33a6eef7-cf14-45cc-82f2-7b63a1dfc9a1 req-0a18ec22-1fc7-467f-93c7-ebd94002ffce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039896 Aug 31 19:38:32.519995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 582/1170] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:33.062673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:33.063412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:33.069977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:33.070610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:33.071090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:33.071796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:33.072267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:33.072697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:33.344476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:33.353003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c17e7110-34c2-4a17-ad17-804c40bcec34 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.294597 Aug 31 19:38:33.353585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 589/1171] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:34.376504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:34.377121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:34.383591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:34.384123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:34.384562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:34.385309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:34.385769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:34.386205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:34.544523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:34.552478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9621fc96-901c-4bb6-9abc-3f029c654307 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.180836 Aug 31 19:38:34.553293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 583/1172] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:35.574010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:35.575448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:35.582527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:35.583045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:35.583490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:35.584198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:35.584657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:35.585093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:35.725993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:35.734959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a09c84dc-8a77-49d4-afd8-e1da0fe72861 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.165060 Aug 31 19:38:35.735533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 590/1173] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:36.756487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:36.757105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:36.763854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:36.764343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:36.764788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:36.765487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:36.766092 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:36.766529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:36.895489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:36.903377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-312f7f82-4276-4cf3-8a62-858af3f13469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.150795 Aug 31 19:38:36.903951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 584/1174] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:37.924635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:37.925252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:37.932314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:37.932737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:37.933178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:37.933870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:37.934328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:37.934757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:38.061138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:38.068693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-52ee4bd8-04f1-462c-a6e6-b96498e3031e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.147925 Aug 31 19:38:38.069258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 591/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:39.091451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:39.092037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:39.094336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:39.099185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:39.099665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:39.100099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:39.100793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:39.101244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:39.101663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:39.243823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:39.252185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bacb1c5-2893-4e99-a602-044c4ae269d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.165502 Aug 31 19:38:39.252757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 585/1176] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:40.273698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:40.274446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:40.276505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:40.277097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:38:40.283225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:40.283720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:40.284169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:40.284903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:40.285367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:40.285797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:40.419615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:40.428289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ebb6c764-11a4-4d32-8f3f-32add8859cc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.158446 Aug 31 19:38:40.428863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 592/1177] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:38:41.450586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:41.451438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:41.458043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:41.458531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:41.459009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:41.459744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:41.460201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:41.460630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:41.603945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:41.612176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2537d6a3-b701-4b74-a5cd-05bd28c57260 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.166068 Aug 31 19:38:41.612745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 586/1178] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:42.634020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:42.634999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:42.644310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:42.645215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:42.645768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:42.646620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:42.647250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:42.647753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:42.789831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:42.797956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9ae10e3f-58e9-4865-9d9c-815e52801ab2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.167944 Aug 31 19:38:42.798582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 593/1179] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:43.819270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:43.819917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:43.826498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:43.827020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:43.831296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:43.832136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:43.832561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:43.833004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:43.980976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:43.991425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4a2448ae-9a51-4702-a9d0-9d901b61d6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.175915 Aug 31 19:38:43.992001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 587/1180] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:44.575896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-5b750a85-45dc-4011-b853-3e8be09765e1 req-f41a7495-3d32-494f-8822-600d59b2e3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bc06b8-f021-4ee4-ace6-d6cc9a4ac438", "name": "network-vif-plugged", "status": "completed", "tag": "18a157bb-7161-4950-9d08-e2f3979e333d"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:44.587977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-5b750a85-45dc-4011-b853-3e8be09765e1 req-f41a7495-3d32-494f-8822-600d59b2e3da service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:44.588151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-5b750a85-45dc-4011-b853-3e8be09765e1 req-f41a7495-3d32-494f-8822-600d59b2e3da service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:44.588590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-5b750a85-45dc-4011-b853-3e8be09765e1 req-f41a7495-3d32-494f-8822-600d59b2e3da service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:44.601558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-5b750a85-45dc-4011-b853-3e8be09765e1 req-f41a7495-3d32-494f-8822-600d59b2e3da service nova] Creating event network-vif-plugged:18a157bb-7161-4950-9d08-e2f3979e333d for instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 on hv-cinder-85220 Aug 31 19:38:44.608476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-5b750a85-45dc-4011-b853-3e8be09765e1 req-f41a7495-3d32-494f-8822-600d59b2e3da service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036088 Aug 31 19:38:44.609183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 594/1181] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:45.012466 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:45.014368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:45.022007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:45.022511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:45.023120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:45.023978 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:45.024492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:45.024971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:45.171450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:45.179129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-aa55d2d4-5b3c-4b6d-ba14-8a7d756337ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.170771 Aug 31 19:38:45.179695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 588/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:46.207910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:46.208614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:46.215303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:46.215789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:46.216226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:46.217086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:46.217731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:46.218164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:46.351719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:46.360632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ef6f61a4-daf4-48c6-ba85-31b6f471b588 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1366 microversion: 2.1 time: 0.157211 Aug 31 19:38:46.361206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 595/1183] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:47.382023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:47.382626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:47.389207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:47.389694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:47.391446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:47.397394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:47.397394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:47.397394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:47.526682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:38:47.535036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e7441c21-6e4b-4b4f-aba5-01e6904312fc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1556 microversion: 2.1 time: 0.157000 Aug 31 19:38:47.535602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 589/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:38:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:38:47.555990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:38:47.556533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:38:47.563724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:47.564572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:47.565131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:47.566072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:47.566641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:47.567179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:47.649795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bb580b14-08ed-42f3-b56c-fa1d2b34b70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097596 Aug 31 19:38:47.650399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 596/1185] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:38:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:38:48.966982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-9693a611-cac8-466f-a932-78be77e9448c req-3a73a3d9-e5ba-46f8-8e0e-256fe6a8ad3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bc06b8-f021-4ee4-ace6-d6cc9a4ac438", "tag": "18a157bb-7161-4950-9d08-e2f3979e333d"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:38:48.978381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9693a611-cac8-466f-a932-78be77e9448c req-3a73a3d9-e5ba-46f8-8e0e-256fe6a8ad3c service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:38:48.978973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9693a611-cac8-466f-a932-78be77e9448c req-3a73a3d9-e5ba-46f8-8e0e-256fe6a8ad3c service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:38:48.979477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-9693a611-cac8-466f-a932-78be77e9448c req-3a73a3d9-e5ba-46f8-8e0e-256fe6a8ad3c service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:38:48.994459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-9693a611-cac8-466f-a932-78be77e9448c req-3a73a3d9-e5ba-46f8-8e0e-256fe6a8ad3c service nova] Creating event network-changed:18a157bb-7161-4950-9d08-e2f3979e333d for instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 on hv-cinder-85220 Aug 31 19:38:48.997497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-9693a611-cac8-466f-a932-78be77e9448c req-3a73a3d9-e5ba-46f8-8e0e-256fe6a8ad3c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Aug 31 19:38:48.998105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 590/1186] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:39:34.132471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:34.133233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=71 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:34.138541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-609197282", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "networks": [{"uuid": "c16b190b-e4ba-4339-a28b-8a9a5f065657"}]}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:34.192697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.network.neutron [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] validate_networks() for [('c16b190b-e4ba-4339-a28b-8a9a5f065657', None, None, None, None, None)] {{(pid=121187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:39:34.534640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Flavor limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:39:34.535108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Image limits 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:39:34.535583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Flavor pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:39:34.535996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Image pref 0:0:0 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:39:34.536409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.virt.hardware [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:39:34.545599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:34.546083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:34.546525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:34.547296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:34.547773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:34.548190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:34.570305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Getting quotas for project 3374fda464574c07a137d5fe03b02712. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:39:34.574301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Getting quotas for user c8214c2eb78f404d94bfc73ca7139e78 and project 3374fda464574c07a137d5fe03b02712. Resources: {'ram', 'cores', 'instances'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:39:34.586799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Going to run 1 instances... {{(pid=121187) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:39:34.589144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:39:34.714119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-96556639-e99c-4ac0-ac4b-3bd76d9b1ecc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583180 Aug 31 19:39:34.714856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 597/1187] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:39:34.726220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d9a13be5-a4b0-4768-a682-ec2cf4dda64f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:34.726961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9a13be5-a4b0-4768-a682-ec2cf4dda64f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:34.730368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=23 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:34.731316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=61 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:34.787511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d9a13be5-a4b0-4768-a682-ec2cf4dda64f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:34.794809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d9a13be5-a4b0-4768-a682-ec2cf4dda64f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1218 microversion: 2.1 time: 0.072905 Aug 31 19:39:34.795674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 591/1188] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:35.816388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:35.817082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:35.823147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:35.823639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:35.824085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:35.825390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:35.825854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:35.826299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:35.890193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:35.898032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-08f426b6-f119-4f02-aa0e-16e52180c307 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1222 microversion: 2.1 time: 0.086100 Aug 31 19:39:35.898990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 598/1189] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:36.920816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:36.921612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:36.928708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:36.929359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:36.929988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:36.930886 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:36.931343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:36.931774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:36.994438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:37.002522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-43d8774b-86f9-4c30-a4c9-74bb2abaa2eb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1288 microversion: 2.1 time: 0.086646 Aug 31 19:39:37.003120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 592/1190] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:36 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:38.023814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:38.024439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:38.031233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:38.031732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:38.032176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:38.032893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:38.033355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:38.033792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:38.222065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:38.230023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9e49b1eb-5f5e-4d2a-9247-10c03400c2d9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.210141 Aug 31 19:39:38.230593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 599/1191] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:38.375400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-2ffa1489-d008-4065-96c6-70e9c36b3b90 req-fe741893-3d47-416d-a6ad-73315f6074ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ae84a4-2370-455d-9fbe-28a42a1f6ece", "tag": "17ba8c5b-a884-442e-be78-ed41d9f6fe68"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:38.385459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-2ffa1489-d008-4065-96c6-70e9c36b3b90 req-fe741893-3d47-416d-a6ad-73315f6074ae service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:38.385944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-2ffa1489-d008-4065-96c6-70e9c36b3b90 req-fe741893-3d47-416d-a6ad-73315f6074ae service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:38.386376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-2ffa1489-d008-4065-96c6-70e9c36b3b90 req-fe741893-3d47-416d-a6ad-73315f6074ae service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:38.398694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-2ffa1489-d008-4065-96c6-70e9c36b3b90 req-fe741893-3d47-416d-a6ad-73315f6074ae service nova] Creating event network-changed:17ba8c5b-a884-442e-be78-ed41d9f6fe68 for instance 04ae84a4-2370-455d-9fbe-28a42a1f6ece on hv-cinder-85220 Aug 31 19:39:38.404061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-2ffa1489-d008-4065-96c6-70e9c36b3b90 req-fe741893-3d47-416d-a6ad-73315f6074ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033090 Aug 31 19:39:38.404855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 593/1192] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:39:39.251228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:39.251855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:39.258591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:39.259132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:39.259573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:39.260283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:39.260743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:39.261174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:39.480932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:39.488414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2bc76ea9-a1de-41b4-9749-3ebcd6b47b07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.241665 Aug 31 19:39:39.489208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 600/1193] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:40.510621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:40.511343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:40.518229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:40.518719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:40.519187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:40.519895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:40.520410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:40.520840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:40.656646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:40.664255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-96b84702-b1d8-4b97-bdb9-d811ce805dd8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.158408 Aug 31 19:39:40.664816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 594/1194] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:41.685743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:41.686386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:41.692786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:41.693266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:41.693720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:41.694394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:41.694846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:41.695294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:41.824207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:41.832358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bea60a3a-1b39-447f-ad36-66aad4982a75 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.151041 Aug 31 19:39:41.832933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 601/1195] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:42.852723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:42.853263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:42.859883 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:42.860374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:42.860814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:42.861525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:42.861987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:42.862422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:42.999001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:43.006671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4add1dfa-c04d-475e-a356-9630748f158b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.158020 Aug 31 19:39:43.007265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 595/1196] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:44.028103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:44.028803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:44.034694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:44.035216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:44.035657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:44.036348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:44.036802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:44.037225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:44.169089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:44.176707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9aa54d19-0e37-4ca0-b2d1-af5f5f6262b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.153202 Aug 31 19:39:44.177819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 602/1197] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:44 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:44.818654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-b6213124-9c72-4050-b04e-db3cb41fbd92 req-9c424bb9-d554-4410-b36a-097aee9214c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ae84a4-2370-455d-9fbe-28a42a1f6ece", "name": "network-vif-plugged", "status": "completed", "tag": "17ba8c5b-a884-442e-be78-ed41d9f6fe68"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:39:44.825431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:44.829547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b6213124-9c72-4050-b04e-db3cb41fbd92 req-9c424bb9-d554-4410-b36a-097aee9214c7 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:44.830027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b6213124-9c72-4050-b04e-db3cb41fbd92 req-9c424bb9-d554-4410-b36a-097aee9214c7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:44.830456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-b6213124-9c72-4050-b04e-db3cb41fbd92 req-9c424bb9-d554-4410-b36a-097aee9214c7 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:44.841701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-b6213124-9c72-4050-b04e-db3cb41fbd92 req-9c424bb9-d554-4410-b36a-097aee9214c7 service nova] Creating event network-vif-plugged:17ba8c5b-a884-442e-be78-ed41d9f6fe68 for instance 04ae84a4-2370-455d-9fbe-28a42a1f6ece on hv-cinder-85220 Aug 31 19:39:44.846453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-b6213124-9c72-4050-b04e-db3cb41fbd92 req-9c424bb9-d554-4410-b36a-097aee9214c7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Aug 31 19:39:44.850172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 596/1198] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:39:45.197505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:45.198109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:45.200031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:45.200916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:39:45.206546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:45.207106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:45.212776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:45.212776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:45.212776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:45.212776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:45.347395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:45.354974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0524f3e4-caec-4496-990a-d4bb735f612e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.161314 Aug 31 19:39:45.356694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 603/1199] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:39:46.376911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:46.377612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:46.384144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:46.384620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:46.385052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:46.385737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:46.386186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:46.387191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:46.531213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:46.538818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3d62ffb2-9800-46a5-a7aa-dc1b4278ab3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1318 microversion: 2.1 time: 0.166525 Aug 31 19:39:46.539406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 597/1200] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:39:47.560069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:39:47.560636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:39:47.567048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:47.567534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:47.568082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:47.568783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:39:47.569241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:39:47.569672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:39:47.701092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:39:47.709272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-aff36633-608a-4d82-9828-6e76b1607567 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1506 microversion: 2.1 time: 0.153307 Aug 31 19:39:47.709853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 604/1201] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:39:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:40:12.682340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f54e6dd-3b9c-4a54-abbd-f839915e23b3", "device": "/dev/sdb"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:40:12.685304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:40:12.688889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=16 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:12.689310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=28 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:12.694852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:40:12.698663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:40:12.698663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:40:12.698663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:40:12.698663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:40:12.699145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:40:13.548779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d617760c-7558-4e01-a42b-e6b4367b2fb7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "POST /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870487 Aug 31 19:40:13.549394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 598/1202] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:40:12 2022] POST /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece/os-volume_attachments => generated 194 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:40:18.752296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:40:18.752909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:40:18.755147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:18.755814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=44 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:40:18.760541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:40:18.761084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:40:18.761519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:40:18.762219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:40:18.762685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:40:18.763140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:40:18.786397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9f2e24e4-65c6-4b94-9a55-d2dc171ed9ad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/ips" status: 200 len: 149 microversion: 2.1 time: 0.037910 Aug 31 19:40:18.787002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 605/1203] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 19:40:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:40:21.408962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "395b4a31-4475-4c6f-a8f6-cdb01ed2ff71"}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:40:21.411509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:40:21.418001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:40:21.418494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:40:21.418975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:40:21.419681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:40:21.420143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:40:21.420572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:40:22.103645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-949ebf2f-9872-46e6-9d5b-ab96eb16b02c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700076 Aug 31 19:40:22.104263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 599/1204] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:40:21 2022] POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:22.493598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "395b4a31-4475-4c6f-a8f6-cdb01ed2ff71"}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:41:22.496625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:22.499823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:41:22.500593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:41:22.508902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:22.509308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:22.509757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:22.510469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:22.510958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:22.511394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:22.655183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Invalid volume: volume 395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 is already attached to instances: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments HTTP/1.1 Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 74 Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 19:41:22.657710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {"volumeAttachment": {"volumeId": "395b4a31-4475-4c6f-a8f6-cdb01ed2ff71"}} Aug 31 19:41:22.659348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Invalid volume: volume 395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 is already attached to instances: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'server_id': '84bc06b8-f021-4ee4-ace6-d6cc9a4ac438', 'body': {'volumeAttachment': {'volumeId': '395b4a31-4475-4c6f-a8f6-cdb01ed2ff71'}}} Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 is already attached to instances: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:41:22.660219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 is already attached to instances: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 19:41:22.661794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 is already attached to instances: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 400 to user: Invalid volume: volume 395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 is already attached to instances: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9b36e497-e6bd-49d4-9323-bd87a2b94406 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170241 Aug 31 19:41:22.664010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 606/1205] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 31 19:41:22 2022] POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 174 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 19:41:22.728090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=4 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:22.728861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:22.729663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:41:22.729813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments/395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 (ip 10.222.0.59) !!! Aug 31 19:41:22.731943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:41:22.732066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments/395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 (ip 10.222.0.59) !!! Aug 31 19:41:22.737642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:22.738216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:22.754287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:22.754774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:22.755249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:22.755952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:22.756410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:22.756839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:22.840106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lazy-loading 'services' on Instance uuid 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:41:23.034973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-96bcfa31-66de-4bfb-a11c-8e678e909317 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments/395b4a31-4475-4c6f-a8f6-cdb01ed2ff71" status: 202 len: 0 microversion: 2.1 time: 0.308615 Aug 31 19:41:23.035566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 600/1206] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:41:22 2022] DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments/395b4a31-4475-4c6f-a8f6-cdb01ed2ff71 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:41:23.044147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:23.046271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:23.054004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:23.054488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:23.054948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:23.060578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:23.060578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:23.060578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:23.086359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f1ea370e-c373-4220-976c-c7abc4968c44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Aug 31 19:41:23.089316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 607/1207] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:41:24.101856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:24.104255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:24.111952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:24.112448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:24.112894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:24.113615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:24.114095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:24.114526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:24.147647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1e5cd9d5-9f06-47a0-a4b0-9989a3740184 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050542 Aug 31 19:41:24.148234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 601/1208] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:25.160689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:25.162988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:25.169625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:25.170115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:25.170560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:25.171289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:25.172363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:25.172782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:25.204698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-93ed4abf-299b-4d84-beea-a62ea69cf1d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048351 Aug 31 19:41:25.205177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 608/1209] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:26.216856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:26.219077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:26.226307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:26.226790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:26.227263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:26.227960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:26.228418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:26.228849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:26.260450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-381c2af2-efc7-432b-93db-dd5944711309 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047578 Aug 31 19:41:26.261014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 602/1210] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:27.273121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:27.275389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:27.282451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:27.282959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:27.283399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:27.284130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:27.284578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:27.285003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:27.315744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-15270e12-fe1c-4b94-a02d-07b8c66c016d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046071 Aug 31 19:41:27.316336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 609/1211] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:41:28.328695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:28.330880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:28.337467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:28.337892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:28.338331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:28.339072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:28.339539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:28.339970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:28.371235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1ae91e66-16f1-473c-8e1d-a8a651822ae2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Aug 31 19:41:28.371816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 603/1212] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:29.384347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:29.386559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:29.393037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:29.393820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:29.394405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:29.395142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:29.395604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:29.396032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:29.426306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5a63eb46-176e-425f-9d62-3a876c01cac8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Aug 31 19:41:29.426863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 610/1213] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:30.437734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:30.439955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:30.446901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:30.447393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:30.447829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:30.448527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:30.448979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:30.449408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:30.479656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ddb28a1e-3915-440f-b313-22d13d189f45 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Aug 31 19:41:30.480216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 604/1214] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:31.492552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:31.494727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:31.501419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:31.501906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:31.502373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:31.503282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:31.503746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:31.504175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:31.535103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d0c0ef4e-9b84-47f5-ac6c-ed0e12b8b72a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045723 Aug 31 19:41:31.535760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 611/1215] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:32.548673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:32.551807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:32.557911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:32.558402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:32.558847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:32.559662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:32.560121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:32.560699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:32.592731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c6a01fd2-f93c-4ffb-92a1-17a9b3d6fc83 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048929 Aug 31 19:41:32.593308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 605/1216] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:33.605704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:33.607998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:33.615860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:33.616527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:33.616972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:33.617687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:33.618148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:33.618581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:33.649940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-789d8683-4134-476f-b2cf-4dff23675833 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048184 Aug 31 19:41:33.650505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 612/1217] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:34.662275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:34.664481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:34.671063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:34.671547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:34.671985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:34.672707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:34.673160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:34.673595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:34.703165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-501baec1-5ab2-4a4f-bf77-3abce97d7df9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Aug 31 19:41:34.703714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 606/1218] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:35.716441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:35.718779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:35.726206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:35.726701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:35.727172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:35.727886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:35.728395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:35.728831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:35.759466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4c8ee861-d73a-4ff0-9dfe-674eec4e9d76 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Aug 31 19:41:35.760026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 613/1219] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:36.772326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:36.774472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:36.780930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:36.781407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:36.781841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:36.782529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:36.783003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:36.783429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:36.813723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-535d2e85-8774-4ca8-962b-91703f8fd7b2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Aug 31 19:41:36.814277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 607/1220] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:37.827024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:37.829267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:37.836783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:37.837274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:37.837747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:37.838462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:37.838954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:37.839391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:37.872261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-787afc1b-a783-4aef-9ed5-ca3ebb25303c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049565 Aug 31 19:41:37.872847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 614/1221] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:38.885396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:38.887565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:38.894522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:38.895278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:38.895849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:38.896556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:38.897013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:38.897442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:38.926509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-96c8d469-4de6-4926-9d04-152b1942c08f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 31 19:41:38.927116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 608/1222] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:39.938820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:39.941107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:39.947550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:39.948037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:39.948484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:39.949183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:39.949644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:39.950079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:39.980561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-66809de0-3f23-4cb3-a0d8-78bcc8523f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Aug 31 19:41:39.981123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 615/1223] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:40.993174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:40.995458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:41.001890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:41.002377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:41.002823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:41.004101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:41.004619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:41.005058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:41.034817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0aca72f4-4b54-4477-b7d6-3a9c42da9d4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 31 19:41:41.035522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 609/1224] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:42.047462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:42.049718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:42.056276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:42.056768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:42.057205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:42.057911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:42.058372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:42.058806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:42.088861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-50f88eec-8c9a-40e6-9988-356cefa4eaa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Aug 31 19:41:42.089342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 616/1225] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:43.102465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:43.104644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:43.111096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:43.111580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:43.112025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:43.112720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:43.113177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:43.113863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:43.144326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dbd898e5-e0ce-47b3-bb13-1e11e2f4df0b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046404 Aug 31 19:41:43.144804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 610/1226] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:44.157386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:44.159528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:44.165873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:44.166368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:44.166790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:44.167510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:44.167976 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:44.168405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:44.199247 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-94ee8738-a5e3-4f1c-9e66-5b475714e806 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046009 Aug 31 19:41:44.199810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 617/1227] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:45.212418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:45.214561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:45.221668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:45.222150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:45.222583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:45.223309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:45.223768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:45.224191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:45.253790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f04e4eb4-5d05-48b2-bd2a-bfa0d49f19a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Aug 31 19:41:45.254354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 611/1228] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:46.266649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:46.268799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:46.275621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:46.276110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:46.276557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:46.277266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:46.277730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:46.278160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:46.308241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f1028780-dff6-4073-b5b4-5a0c0f6d5d4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Aug 31 19:41:46.308794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 618/1229] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:47.320236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:47.322374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:47.328962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:47.329467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:47.329917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:47.330585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:47.331063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:47.331521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:47.361005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e7668d4a-53c0-4302-8ad3-a4925429439e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044985 Aug 31 19:41:47.361552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 612/1230] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:48.372444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:48.374699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:48.381192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:48.381676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:48.382114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:48.382893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:48.383362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:48.383853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:48.414513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5e3596c2-9063-428a-bceb-45ff24b631d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Aug 31 19:41:48.415183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 619/1231] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:49.427055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:49.429879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:49.436318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:49.436805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:49.437245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:49.437944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:49.438408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:49.438837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:49.470069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2b99b75d-3833-402e-9f2c-5797beba9bd5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047089 Aug 31 19:41:49.470639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 613/1232] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:50.483970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:50.486164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:50.493299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:50.493865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:50.494303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:50.495032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:50.495483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:50.495932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:50.525720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-034c24b1-d303-49af-9125-3db50bf5b6f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Aug 31 19:41:50.526288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 620/1233] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:51.537477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:51.539773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:51.546222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:51.546711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:51.547214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:51.547918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:51.548377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:51.548808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:51.579774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4dbc714e-394c-48e4-8094-a17b962427af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Aug 31 19:41:51.580338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 614/1234] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:52.592244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:52.594452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:52.596767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=33 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:52.601694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:52.602198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:52.602647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:52.603377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:52.603841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:52.604272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:52.608017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=95 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:52.634736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6d76305c-2db1-4aa8-aa2c-5ae3dcb831bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046434 Aug 31 19:41:52.635319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 621/1235] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:53.647220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:53.649495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:53.651955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=31 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:53.656575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:53.657054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:53.657490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:53.658181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:53.658639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:53.659088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:53.661416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:41:53.689841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-281684a6-8ff6-4d6c-a6a1-599c7b911038 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046604 Aug 31 19:41:53.690406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 615/1236] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:54.702511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:54.704776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:54.711453 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:54.711942 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:54.712387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:54.713174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:54.713640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:54.714080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:54.745581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bbc55e18-bdad-4bd2-9ecc-13b1375b84b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047712 Aug 31 19:41:54.746141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 622/1237] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:41:55.759067 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:55.761236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:55.768297 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:55.768786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:55.769276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:55.769980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:55.770440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:55.770903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:55.802129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c752dc62-51f4-4e1d-b5d4-fa90196e05bf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047696 Aug 31 19:41:55.802683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 616/1238] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:56.814455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:56.816670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:56.823814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:56.824295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:56.824737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:56.825432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:56.826142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:56.826568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:56.856022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9a11db61-aa51-43ee-9e62-33a05da78d63 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Aug 31 19:41:56.856579 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 623/1239] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:57.868730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:57.871595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:57.877931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:57.878403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:57.878842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:57.879555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:57.880005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:57.880425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:57.909840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-795cca61-8035-4087-92a3-7248bf547508 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Aug 31 19:41:57.910391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 617/1240] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:58.922397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:58.924628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:58.931148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:58.931638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:58.932259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:58.932957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:58.933415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:58.933889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:58.963822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2e69a063-1748-43a4-9683-e5f89406e97e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Aug 31 19:41:58.964384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 624/1241] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:41:59.976031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:41:59.978176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:41:59.984890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:59.985373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:59.985814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:41:59.986512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:41:59.986992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:41:59.987420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:00.017501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-66838e17-94e9-4f1c-9e79-7e6c3688d541 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045461 Aug 31 19:42:00.018059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 618/1242] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:41:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:42:01.030073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:01.032363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:01.039074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:01.039569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:01.040015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:01.040718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:01.041181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:01.042671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:01.072103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cc028131-2165-4e11-918f-d3e6417d3134 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046817 Aug 31 19:42:01.072667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 625/1243] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:02.085284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:02.087516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:02.094088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:02.094574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:02.095115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:02.095818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:02.096276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:02.096707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:02.126993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a6c34249-b98e-47a5-bbfc-c0d191de7a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Aug 31 19:42:02.127548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 619/1244] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:03.138985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:03.141096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:03.147466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:03.147941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:03.148374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:03.149059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:03.149504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:03.149928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:03.179014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-11e5ab50-e343-45a2-af5c-fa699301c33d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Aug 31 19:42:03.179569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 626/1245] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:04.192026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:04.194176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:04.201185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:04.201664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:04.202103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:04.202803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:04.203289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:04.203715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:04.233812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e54d732f-b2b5-4381-8d9d-b94ddd3364b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Aug 31 19:42:04.234296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 620/1246] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:05.246645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:05.248754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:05.255203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:05.255681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:05.256117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:05.256802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:05.257254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:05.257694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:05.287151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a3f44b33-55d8-4d68-8426-bc6aeae9ddcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Aug 31 19:42:05.287715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 627/1247] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:06.299551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:06.301798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:06.308746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:06.309219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:06.309648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:06.310334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:06.310785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:06.311231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:06.343613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f6a0525d-9ecd-420b-9b91-40768243b851 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048010 Aug 31 19:42:06.344180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 621/1248] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:07.356186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:07.358533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:07.365015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:07.365493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:07.365927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:07.366621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:07.367102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:07.367534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:07.397249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a3285e3a-222f-49fc-81f8-87085d521903 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Aug 31 19:42:07.397826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 628/1249] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:08.409870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:08.412130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:08.419210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:08.419700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:08.420158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:08.420892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:08.421352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:08.421785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:08.452631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5e8690d6-6474-445b-9a8d-cc9e93bf663c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Aug 31 19:42:08.453189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 622/1250] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:09.465005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:09.467206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:09.473835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:09.474319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:09.474761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:09.475497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:09.475958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:09.476391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:09.507017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3fca24c4-1a63-43b9-a955-97c3ce4b19d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046008 Aug 31 19:42:09.507584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 629/1251] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:10.520124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:10.522276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:10.529349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:10.529762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:10.530196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:10.530914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:10.531366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:10.531788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:10.561397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eb49c0ed-4f6f-456f-aff5-79222bb3ef46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Aug 31 19:42:10.561960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 623/1252] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:42:11.573887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:11.576360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:11.583061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:11.583223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:11.583663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:11.584358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:11.584812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:11.585234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:11.615610 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4c6bc85e-8885-4908-aa34-e681282f04b8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Aug 31 19:42:11.616172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 630/1253] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:12.627929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:12.630071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:12.637104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:12.637585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:12.638023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:12.638718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:12.639204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:12.639632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:12.669323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f43ab7da-cbbe-40fc-b0c5-18ff7f98aaa5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Aug 31 19:42:12.669878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 624/1254] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:13.681756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:13.684688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:13.690692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:13.691220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:13.691665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:13.692373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:13.692833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:13.693266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:13.724476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7108241c-2aef-4477-8189-f54b0886e2d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Aug 31 19:42:13.724476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 631/1255] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:14.737441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:14.739773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:14.748076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:14.748598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:14.749035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:14.749763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:14.750568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:14.750686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:14.781205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-401716a3-7db5-4e3e-b8ee-8daa340c9f27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048191 Aug 31 19:42:14.781750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 625/1256] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:15.793117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:15.795368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:15.801655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:15.802141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:15.802583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:15.803319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:15.803780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:15.804211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:15.837801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0a504624-391c-416e-a200-7dbf857996a8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049360 Aug 31 19:42:15.839719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 632/1257] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:16.851181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:16.853373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:16.860280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:16.860766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:16.861208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:16.861909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:16.862370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:16.862808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:16.892166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d06db69a-9e66-4c4f-be10-ce7ef6e900cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Aug 31 19:42:16.892722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 626/1258] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:17.904375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:17.906551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:17.912999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:17.913486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:17.913930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:17.914631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:17.915124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:17.915560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:17.945853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ac1b25ec-efa1-4668-bae5-10de8f11da88 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Aug 31 19:42:17.946415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 633/1259] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:18.957877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:18.960133 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:18.966758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:18.967281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:18.967726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:18.968424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:18.968881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:18.969311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:18.999151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-135f3b0f-31c0-4307-8576-bf88e0208cca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045219 Aug 31 19:42:18.999705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 627/1260] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:20.011393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:20.013587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:20.020129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:20.020615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:20.021058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:20.021764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:20.022230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:20.022664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:20.053120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a4043470-5816-48c7-bca0-b723438c506d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045621 Aug 31 19:42:20.053671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 634/1261] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:21.065611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:21.067844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:21.074238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:21.074712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:21.075429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:21.076122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:21.076572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:21.076995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:21.106679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-671ef37a-26c7-4e78-9d0b-41f7149ab742 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Aug 31 19:42:21.107267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 628/1262] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:22.119193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:22.121518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:22.128165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:22.128658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:22.129108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:22.129818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:22.130282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:22.130720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:22.160676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b0a99d66-4654-4e72-b0fe-532744d1d01d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Aug 31 19:42:22.161234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 635/1263] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:23.172914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:23.175110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:23.181526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:23.182010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:23.182575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:23.183304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:23.183760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:23.184188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:23.214465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c02b067e-b488-42e3-96e9-961894f508d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Aug 31 19:42:23.215090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 629/1264] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:24.226401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:24.228647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:24.231938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=30 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:24.236679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:24.237170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:24.237612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:24.238320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:24.238846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:24.247684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:24.270108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-69342349-ea04-433a-86f7-1a5ed63ddb97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047546 Aug 31 19:42:24.270611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 636/1265] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:25.282443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:25.284711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:25.287288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=30 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:25.292142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:25.292620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:25.296840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:25.296840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:25.296840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:25.296840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:25.326036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3224d084-2cda-468d-8869-883fa8f02a12 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047529 Aug 31 19:42:25.326585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 630/1266] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:26.338388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:26.340598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:26.347155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:26.347634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:26.348065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:26.348751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:26.349200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:26.349621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:26.353158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:26.380572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7a6efbae-2df4-495e-980b-900fb66e1116 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046078 Aug 31 19:42:26.381130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 637/1267] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:27.393302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:27.395466 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:27.401989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:27.403392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:27.403392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:27.403722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:27.404175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:27.404598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:27.428972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:27.434149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5064b5a0-a629-428a-81cd-d607965a01f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Aug 31 19:42:27.437782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 631/1268] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:28.446308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:28.449131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:28.455868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:28.456349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:28.456783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:28.457471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:28.457923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:28.458348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:28.489179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4d3b9e30-cdb6-41fe-a3db-b331966c7bdf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047250 Aug 31 19:42:28.489744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 638/1269] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:29.501513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:29.503708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:29.510673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:29.511236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:29.511682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:29.512386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:29.512846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:29.513280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:29.544649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3ee80097-2518-4abf-a58c-8bd450a5d629 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Aug 31 19:42:29.545150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 632/1270] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:30.557803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:30.560044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:30.566548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:30.567084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:30.567529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:30.568255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:30.568715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:30.569149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:30.599591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8ca8606d-9271-4d27-a288-e9ce41dac129 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 Aug 31 19:42:30.600158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 639/1271] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:31.612426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:31.614979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:31.622182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:31.622661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:31.623141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:31.623840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:31.624292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:31.624715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:31.655531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9d072a47-0c44-4bc2-8ec5-1fd5d84abcff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047055 Aug 31 19:42:31.656104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 633/1272] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:32.668502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:32.670733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:32.677263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:32.677894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:32.678205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:32.678937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:32.679400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:32.679848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:32.709747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f72f6bf7-10ff-47f9-8dd0-294695092b72 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045976 Aug 31 19:42:32.710317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 640/1273] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:33.722994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:33.725162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:33.731264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:33.731750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:33.732189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:33.732895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:33.733351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:33.733780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:33.763986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6c8eb1df-4790-4916-a3c1-b85d74f863ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Aug 31 19:42:33.764730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 634/1274] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:34.776417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:34.779232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:34.785795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:34.786287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:34.786730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:34.787465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:34.787924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:34.788360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:34.818116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7ce2b1c5-7981-48b6-930d-54e568891b2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 31 19:42:34.818737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 641/1275] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:35.832645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:35.834798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:35.841971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:35.842455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:35.842916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:35.843621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:35.844074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:35.844502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:35.873755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e4d65d9f-1c6a-4337-9565-8491185b5564 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Aug 31 19:42:35.874314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 635/1276] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:36.885774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:36.888772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:36.895221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:36.895702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:36.896137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:36.896831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:36.897278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:36.897700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:36.926632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9e609be3-a58d-4bc6-95ab-53db3beaa197 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Aug 31 19:42:36.927207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 642/1277] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:37.939628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:37.941817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:37.949183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:37.949482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:37.950336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:37.951422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:37.951929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:37.952615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:37.983614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-27b7bf20-02da-4a43-a796-3033239923a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047990 Aug 31 19:42:37.984178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 636/1278] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:38.997058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:38.999301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:39.005791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:39.006295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:39.006796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:39.007532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:39.008030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:39.008467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:39.038768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d11d2d51-d9e5-4336-8602-8b20a4967860 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 31 19:42:39.039385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 643/1279] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:42:40.053313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:40.055487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:40.062646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:40.063156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:40.063592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:40.064435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:40.065173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:40.065711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:40.096277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-870798fb-fe3c-4a20-96db-70f427c07f9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 31 19:42:40.096835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 637/1280] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:41.108639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:41.110849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:41.117400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:41.117890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:41.118343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:41.119085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:41.119550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:41.119984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:41.150337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3f1f0e44-441d-4c49-8a7c-ef53d6235069 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Aug 31 19:42:41.150946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 644/1281] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:42.163429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:42.165580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:42.172792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:42.173277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:42.173706 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:42.174399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:42.174846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:42.175290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:42.204416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-da52902f-0ed0-41b6-aa1a-12534825d8fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Aug 31 19:42:42.204969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 638/1282] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:43.217254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:43.219398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:43.225938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:43.226436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:43.226897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:43.227628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:43.228100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:43.228538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:43.258898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-752f7cdd-f623-4a67-85aa-797db3cbae59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Aug 31 19:42:43.259476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 645/1283] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:44.271204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:44.273382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:44.281124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:44.281618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:44.282088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:44.282796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:44.283280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:44.283709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:44.313470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-16872964-9393-4534-aa87-0e9bdd079fa0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 31 19:42:44.314028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 639/1284] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:45.327253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:45.329463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:45.335831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:45.336315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:45.336756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:45.337451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:45.337906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:45.338339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:45.369049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-be15b654-1cff-4fb0-9c09-fa770b0de9ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046347 Aug 31 19:42:45.369603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 646/1285] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:46.380869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:46.383146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:46.390261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:46.390741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:46.391210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:46.392012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:46.392471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:46.392900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:46.423172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b742e068-519f-47cf-a20c-ddca96f4cbca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Aug 31 19:42:46.423727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 640/1286] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:47.435509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:47.437736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:47.444336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:47.444821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:47.445297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:47.446026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:47.446488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:47.446960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:47.476668 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3f7206db-db79-4064-b2ee-29ac6ea35ccd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Aug 31 19:42:47.477232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 647/1287] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:48.489177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:48.491381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:48.498641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:48.499157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:48.499600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:48.500360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:48.500823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:48.501258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:48.532521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-62a66cb4-41ba-47cf-a30a-85d044bd03cb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047495 Aug 31 19:42:48.533001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 641/1288] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:49.544868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:49.547034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:49.553451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:49.553959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:49.554419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:49.555105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:49.555558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:49.555982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:49.587147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-69c546ce-1532-4baa-8556-8a05a5a97381 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Aug 31 19:42:49.587745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 648/1289] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:50.599704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:50.601920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:50.609167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:50.609751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:50.610198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:50.610947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:50.611419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:50.611859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:50.643302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-55eec1c5-f4c1-4c59-bfac-e6059ba1d738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047469 Aug 31 19:42:50.643875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 642/1290] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:42:51.655878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:51.658076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:51.664576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:51.665064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:51.665516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:51.666250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:51.666714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:51.667183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:51.697179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-781bc722-ff7c-488d-83c6-149ba88cef1c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Aug 31 19:42:51.697735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 649/1291] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:52.710340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:52.712561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:52.719815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:52.720304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:52.720750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:52.721457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:52.721915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:52.722348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:52.761423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-330adabd-b223-4ddd-bc19-c3631938b640 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055154 Aug 31 19:42:52.761989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 643/1292] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:53.774595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:53.776971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:53.784125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:53.784618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:53.785063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:53.785780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:53.786244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:53.786672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:53.818761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-81662dc4-f3c2-4822-a4e2-293c5d7b612b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Aug 31 19:42:53.819381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 650/1293] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:42:54.831783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:54.833925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:54.840387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:54.840872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:54.841313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:54.842009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:54.843264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:54.843701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:54.876247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-13b50a3c-fa51-434f-b6bc-4c51d796abfd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Aug 31 19:42:54.876822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 644/1294] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:55.888717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:55.891045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:55.897390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:55.897878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:55.898317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:55.899055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:55.899510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:55.899938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:55.929209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e4e86555-6823-4a26-b2c4-b1c367462391 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Aug 31 19:42:55.929756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 651/1295] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:56.941590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:56.943837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:56.946116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=30 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:56.951017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:56.951505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:56.951941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:56.953293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:56.953739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:56.954164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:56.983845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-62e7bb4c-3410-41d5-b625-814640bf7d31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 31 19:42:56.984592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 645/1296] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:57.997067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:57.999561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:58.002070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:42:58.006777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:58.007293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:58.007740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:58.008437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:58.008919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:58.009347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:58.041913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-02d4eb91-ac9c-4148-a86d-317d0d9bab7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048780 Aug 31 19:42:58.042490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 652/1297] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:42:59.055483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:42:59.057662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:42:59.064743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:59.065288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:59.065723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:59.066423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:42:59.066898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:42:59.067316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:42:59.097074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-aacacd4a-3556-4f26-9cac-1e7773d28c73 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Aug 31 19:42:59.097625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 646/1298] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:42:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:00.109447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:00.111715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:00.118608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:00.119124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:00.119565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:00.120284 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:00.120737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:00.121164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:00.123745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:00.153229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-09b49b89-7667-406b-a1b1-78846b781bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047748 Aug 31 19:43:00.153795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 653/1299] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:01.166329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:01.168640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:01.175847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:01.176341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:01.176778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:01.177484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:01.177938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:01.178364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:01.180835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=92 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:01.209814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8ea13999-ab60-4326-b204-3c57ea32aa77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047472 Aug 31 19:43:01.210386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 647/1300] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:43:02.222171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:02.224358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:02.231158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:02.231639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:02.232072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:02.232761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:02.233216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:02.233638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:02.263254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1fe99411-9de0-4d1c-8993-5325dc673890 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Aug 31 19:43:02.263812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 654/1301] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:03.278226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:03.280539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:03.288535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:03.289022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:03.289471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:03.290179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:03.290640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:03.291102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:03.321019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-48a984cc-34d3-4c36-9c8d-2726d7a2d800 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049176 Aug 31 19:43:03.321587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 648/1302] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:04.334201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:43:04.334754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:43:04.550268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:04.552500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:04.559416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:04.559909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:04.560354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:04.561062 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:04.561522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:04.561955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:04.592839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-42ddcc48-2f6e-4874-91cb-419573d88b64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.263844 Aug 31 19:43:04.593411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 655/1303] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:43:05.605894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:05.608636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:05.616044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:05.616536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:05.616975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:05.617717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:05.618310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:05.618768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:05.650287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-285f9228-b874-40d2-8a88-dedd0434a100 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048344 Aug 31 19:43:05.650849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 649/1304] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:06.663655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:06.665940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:06.671919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:06.672403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:06.672848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:06.673582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:06.674043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:06.674477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:06.703399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3db6fcb3-a8b6-4539-9002-3bf2fdc350b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Aug 31 19:43:06.703956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 656/1305] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:07.716362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:07.718590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:07.725706 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:07.726198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:07.726641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:07.727370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:07.727840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:07.728283 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:07.758142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-31a872e4-a5f0-4ab2-af80-db25a1f646bc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045694 Aug 31 19:43:07.758733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 650/1306] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:08.770558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:08.772793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:08.779295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:08.779776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:08.780215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:08.780908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:08.781364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:08.781791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:08.810811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e3d0d1e0-4c6c-407d-a37d-2d21e8f923d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Aug 31 19:43:08.811390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 657/1307] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:09.823900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:09.826395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:09.832962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:09.833448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:09.833916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:09.834613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:09.835101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:09.835533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:09.866119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a29cf300-059d-47bb-9d7e-d9af8f6c96c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046197 Aug 31 19:43:09.866682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 651/1308] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:10.879193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:10.881422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:10.887881 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:10.888367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:10.888814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:10.889514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:10.889979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:10.890437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:10.920743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-71e66567-f2ee-4d69-80c5-3ca8e9b0817e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 Aug 31 19:43:10.921305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 658/1309] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:11.934268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:11.936425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:11.942892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:11.943370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:11.943813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:11.944504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:11.944957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:11.945372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:11.983949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-04969b54-07cc-49a4-bfd8-11a692fafa41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053635 Aug 31 19:43:11.984565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 652/1310] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:12.996716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:12.998980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:13.005853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:13.006383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:13.006825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:13.007550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:13.008004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:13.008430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:13.038279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-57ce957c-6236-4036-98ad-9d1e6c401031 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Aug 31 19:43:13.038830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 659/1311] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:14.051353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:14.053486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:14.060060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:14.060546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:14.060988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:14.061697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:14.062156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:14.062587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:14.093699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a64138a2-975f-4c3f-992c-f0c06c227efa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 Aug 31 19:43:14.094257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 653/1312] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:15.105726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:15.107924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:15.114947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:15.115434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:15.115872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:15.116572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:15.117024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:15.117450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:15.148563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9387f10c-42df-44ee-b4aa-129f7c1c7c15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 Aug 31 19:43:15.149118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 660/1313] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:16.162050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:16.164252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:16.170729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:16.171247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:16.171692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:16.172432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:16.172905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:16.173337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:16.205124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b9553cd6-b881-4632-b038-908dd52972ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047935 Aug 31 19:43:16.206208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 654/1314] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:17.221858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:17.224272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:17.231138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:17.231576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:17.232023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:17.232739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:17.233203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:17.233625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:17.266907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-90904dd7-cec0-4ee6-8d08-1cfe465c8cbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049088 Aug 31 19:43:17.267631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 661/1315] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:18.280088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:18.282284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:18.289452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:18.289936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:18.290376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:18.291153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:18.291615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:18.292043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:18.323698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2f23e4ce-e060-4efa-843d-831110f39753 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047693 Aug 31 19:43:18.324535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 655/1316] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:19.336853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:19.339065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:19.345600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:19.346088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:19.346556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:19.347351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:19.347844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:19.348274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:19.379313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9fafe96e-2d23-4757-bd52-8d2c1d4d06ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046297 Aug 31 19:43:19.379892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 662/1317] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:20.391368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:20.393726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:20.400364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:20.400918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:20.401364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:20.402044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:20.402361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:20.403083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:20.433338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1b1ac78a-3929-4945-a96d-e2d99b0883ce tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046089 Aug 31 19:43:20.433897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 656/1318] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:21.445970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:21.448213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:21.455023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:21.456025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:21.456589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:21.457310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:21.457773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:21.458209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:21.488719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8d578401-5437-4529-8ebd-2e57493560c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046683 Aug 31 19:43:21.489299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 663/1319] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:22.501851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:22.504827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:22.511552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:22.512045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:22.512485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:22.513196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:22.513659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:22.514093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:22.545151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-32432a2a-9f1d-44d7-9854-15077ef8f3bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047212 Aug 31 19:43:22.545660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 657/1320] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:43:23.558271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:23.560426 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:23.568217 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:23.568710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:23.569159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:23.569874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:23.570336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:23.570770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:23.602171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-53e4320c-9a93-42cf-9db6-938bf8a5641d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047975 Aug 31 19:43:23.602802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 664/1321] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:24.613970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:24.616257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:24.631156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:24.631156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:24.631156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:24.631156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:24.631642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:24.631642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:24.655328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b566ef00-8af8-482e-909f-9d6ab7cbd3a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Aug 31 19:43:24.655897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 658/1322] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:25.668165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:25.670372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:25.677062 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:25.677534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:25.677967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:25.678670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:25.680838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:25.680838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:25.712322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a7be99e9-571b-49ae-a3a6-70b377d73784 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048695 Aug 31 19:43:25.712893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 665/1323] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:26.724322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:26.726473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:26.733194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:26.733687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:26.734128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:26.734834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:26.735312 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:26.735739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:26.767386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a025755d-dd42-410e-b343-d0d410685033 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046925 Aug 31 19:43:26.767959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 659/1324] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:27.780667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:27.782941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:27.789971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:27.790511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:27.790984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:27.791704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:27.792171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:27.792605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:27.823269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e4aae5a1-f315-4f27-b007-6a39359939fa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Aug 31 19:43:27.824089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 666/1325] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:28.835694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:28.838367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:28.840792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=30 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:28.845587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:28.846062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:28.846496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:28.847224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:28.847675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:28.848108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:28.878656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5ed95ee5-3857-4d94-b154-5f9807b4aec9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046640 Aug 31 19:43:28.879248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 660/1326] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:29.890615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:29.892898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:29.899760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:29.900251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:29.900703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:29.901409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:29.901873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:29.902305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:29.934106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c302ed50-a67a-4093-bee3-c471d44be672 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047411 Aug 31 19:43:29.934594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 667/1327] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:30.946638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:30.949117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:30.956071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:30.956551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:30.956986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:30.957678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:30.958132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:30.958555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:30.988077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9a3930f5-8909-4eab-8f57-a6eb3c9b02d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Aug 31 19:43:30.988962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 661/1328] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:32.001393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:32.003649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:32.006102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:32.011644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:32.012130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:32.012571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:32.013274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:32.013787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:32.014218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:32.044752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a6d5f871-50af-41ab-b25b-e7c7895a0606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Aug 31 19:43:32.045380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 668/1329] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:33.058139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:33.060318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:33.066412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:33.066921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:33.067367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:33.068069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:33.068523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:33.068975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:33.098510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-391243d7-e97e-4a0b-9247-0aae3dbcf5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Aug 31 19:43:33.099103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 662/1330] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:34.111380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:34.113665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:34.120725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:34.121209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:34.121645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:34.122339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:34.122789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:34.123248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:34.125619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:34.153657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3841655e-1416-457b-ada1-398002e70b3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046293 Aug 31 19:43:34.154218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 669/1331] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:35.166663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:35.169075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:35.175666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:35.176154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:35.176607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:35.179542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:35.179542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:35.179542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:35.180550 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:43:35.211409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-268e5646-df81-4f17-bdc5-1de9207a3d01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049345 Aug 31 19:43:35.211988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 663/1332] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:36.223755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:36.225914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:36.233689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:36.234172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:36.234608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:36.235344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:36.235798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:36.236224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:36.268139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92b15297-dc0d-4951-9fc1-214e6a609124 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048193 Aug 31 19:43:36.268626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 670/1333] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:37.281285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:37.283548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:37.290228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:37.290709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:37.291928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:37.292635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:37.293082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:37.293507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:37.324129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-91253066-ac8e-4fb4-9255-7ac9569239b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046923 Aug 31 19:43:37.324693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 664/1334] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:38.336840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:38.339124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:38.345593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:38.346082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:38.346523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:38.347252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:38.347710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:38.348139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:38.378860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-94c3a8f7-da7b-421f-9475-348b67df49c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Aug 31 19:43:38.379603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 671/1335] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:39.391423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:39.393672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:39.401149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:39.401679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:39.402121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:39.402835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:39.403330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:39.403767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:39.436897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b428f082-5148-488b-acdb-92f1430e5acc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049568 Aug 31 19:43:39.437476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 665/1336] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:40.450519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:40.452796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:40.459460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:40.459947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:40.460410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:40.461099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:40.461558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:40.461997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:40.491934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8dfef544-1a86-4006-a12b-8a0dd58cd49c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046399 Aug 31 19:43:40.492507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 672/1337] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:41.503828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:41.506049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:41.513367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:41.513844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:41.514278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:41.514999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:41.515450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:41.515872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:41.545644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5da65bf5-6e06-40fd-94f6-b5edaca67024 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Aug 31 19:43:41.546127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 666/1338] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:42.558534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:42.560697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:42.567177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:42.567743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:42.568182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:42.568886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:42.569348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:42.569780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:42.600331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0434f69f-3906-49a9-8645-762486e2b98a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046543 Aug 31 19:43:42.600899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 673/1339] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:43.616028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:43.618163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:43.625952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:43.626440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:43.626893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:43.627604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:43.628060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:43.628488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:43.660222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5b726277-e6b5-47e0-8ede-289f58b201bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048801 Aug 31 19:43:43.660790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 667/1340] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:44.672911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:44.675112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:44.681077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:44.681564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:44.682011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:44.683288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:44.683767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:44.684200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:44.714512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-07402328-961a-4a0c-a762-da458b2b55d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Aug 31 19:43:44.715098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 674/1341] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:45.726855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:45.729019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:45.735885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:45.736403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:45.736855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:45.737548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:45.738001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:45.738426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:45.769635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d6eca302-5ed9-435b-8dd0-eaaaf40fb8bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Aug 31 19:43:45.770205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 668/1342] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:46.782578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:46.784912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:46.791759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:46.792265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:46.792711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:46.793498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:46.793962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:46.795283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:46.826701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d10d8cb5-2884-445e-978f-4b2c4b013f03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048516 Aug 31 19:43:46.827305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 675/1343] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:47.839280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:47.842168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:47.848827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:47.849313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:47.849758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:47.850465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:47.850948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:47.851381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:47.882121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4af6feb0-0949-4a07-9ea6-aa722610d656 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Aug 31 19:43:47.882712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 669/1344] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:48.894861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:48.897041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:48.903438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:48.904421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:48.904857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:48.905553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:48.906003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:48.906425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:48.937152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b64abbce-d647-4bbb-abf1-602ee2be27e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Aug 31 19:43:48.937723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 676/1345] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:49.949933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:49.952876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:49.959341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:49.959822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:49.960262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:49.960956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:49.961414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:49.961840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:49.992100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9f250187-940f-4e8e-9d63-c0f89e25f5b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Aug 31 19:43:49.992659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 670/1346] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:51.004922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:51.007238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:51.013806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:51.014295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:51.014823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:51.015604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:51.016077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:51.016503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:51.045619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d8dd7bd4-1b50-4dad-916d-844de816ba11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Aug 31 19:43:51.046859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 677/1347] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:43:52.058025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:52.060284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:52.067596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:52.068077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:52.068518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:52.069218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:52.069673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:52.070102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:52.100666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-56fd3449-d5e2-4eaa-86e0-59daebff63b6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046617 Aug 31 19:43:52.101233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 671/1348] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:53.113343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:53.115574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:53.122156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:53.122638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:53.123111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:53.123899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:53.124467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:53.124903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:53.154593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-41fba016-c65a-46e2-b0fe-8a405d2294a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Aug 31 19:43:53.155195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 678/1349] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:54.167754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:54.170040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:54.178033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:54.178532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:54.179197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:54.179765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:54.180219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:54.180647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:54.212225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9e78485a-f37b-40e8-b17f-0a7a55823d65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 Aug 31 19:43:54.212782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 672/1350] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:55.224022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:55.226636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:55.233020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:55.233503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:55.233946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:55.234674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:55.235899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:55.236345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:55.267854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-317fa50e-bdcf-4dcc-b1e2-ddf11c26691d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047784 Aug 31 19:43:55.268350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 679/1351] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:56.280236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:56.283260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:56.289863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:56.290353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:56.290793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:56.291581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:56.292065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:56.292503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:56.324200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2df6bc21-3551-4bea-a0ac-f1169a894f5d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Aug 31 19:43:56.324756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 673/1352] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:57.336547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:57.338742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:57.345885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.346371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.346814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.347543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:57.348004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:57.348435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:57.379581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ebacc733-d7ee-4675-9dd5-b4ade5ce8c51 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046917 Aug 31 19:43:57.380143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 680/1353] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:58.391968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:58.394451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:58.400962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:58.401449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:58.401892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:58.402594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:58.403081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:58.403510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:58.435246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-65043854-b9ee-459e-8a83-eed8a0091761 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047141 Aug 31 19:43:58.435952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 674/1354] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:43:59.449046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:43:59.451270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:43:59.458428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:59.458948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:59.459396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:59.460150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:43:59.460617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:43:59.461051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:43:59.491142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8ef74162-bbe1-4760-a99d-1404d8a52603 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Aug 31 19:43:59.491708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 681/1355] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:43:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:00.503825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:00.505888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:00.512372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:00.512851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:00.513286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:00.513979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:00.514436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:00.514859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:00.545130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-770e7750-e9d7-4fb3-99e8-9b34d6187d27 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045482 Aug 31 19:44:00.545683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 675/1356] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:01.557492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:01.559619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:01.566504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:01.567070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:01.567522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:01.568261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:01.568872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:01.569308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:01.601467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a681c268-d2d8-49c7-95bc-521cfbdb8a5e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047961 Aug 31 19:44:01.602040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 682/1357] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:02.614592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:02.616820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:02.619054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=32 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:02.623828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:02.624347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:02.624790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:02.625620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:02.626097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:02.627486 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:02.659110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e6d5dca-94f5-44f7-bad0-5fb1e4da346c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049216 Aug 31 19:44:02.661489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 676/1358] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:03.671575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:03.674290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:03.680805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:03.681297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:03.681744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:03.682452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:03.682944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:03.683382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:03.713824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d4266277-6cae-46d2-bf0f-9b582518a770 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Aug 31 19:44:03.714422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 683/1359] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:04.726165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:04.728363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:04.735058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:04.735551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:04.736309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:04.737206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:04.737670 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:04.738101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:04.772309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5ee5fba2-099a-4e4c-9355-90629a7b09ae tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050103 Aug 31 19:44:04.772873 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 677/1360] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:05.785549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:05.787776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:05.790177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:05.795067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:05.795609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:05.796068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:05.796763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:05.797214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:05.797639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:05.831521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2e59934a-040b-4505-a0e5-9f216814dad3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050058 Aug 31 19:44:05.831997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 684/1361] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:06.843897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:06.846316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:06.852939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:06.853432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:06.853875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:06.854582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:06.855076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:06.855519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:06.887632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-799ce5c5-d633-4856-93fb-ec4944a42bbd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047696 Aug 31 19:44:06.888209 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 678/1362] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:07.900883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:07.903090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:07.910722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:07.911236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:07.911968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:07.912365 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:07.912818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:07.913243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:07.915767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:07.943990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b6150d63-1abb-465f-a702-7d4c601c9736 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047186 Aug 31 19:44:07.944618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 685/1363] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:08.956551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:08.958823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:08.965220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:08.965709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:08.966150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:08.966943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:08.967407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:08.967893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:08.970328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:09.000596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-745e1f47-0397-45a2-9d1c-3a8737f6b0f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047913 Aug 31 19:44:09.001232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 679/1364] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:10.013732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:10.016008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:10.023312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:10.023793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:10.024273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:10.024962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:10.025414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:10.025839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:10.056820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b47aae01-06d0-4a60-bf77-408e62070919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047335 Aug 31 19:44:10.057386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 686/1365] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:11.069826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:11.072041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:11.078751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:11.079255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:11.079695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:11.080385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:11.081347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:11.082064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:11.111788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b4e6ee53-2fe0-4170-8345-825f9b7d5131 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Aug 31 19:44:11.112506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 680/1366] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:12.124020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:12.126176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:12.132768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:12.133258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:12.133699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:12.134392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:12.134847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:12.135297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:12.164868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-70f7e48a-6f83-416f-ba61-64bf7fd37ae3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Aug 31 19:44:12.165431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 687/1367] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:44:13.177172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:13.179342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:13.185826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:13.186311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:13.186753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:13.187507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:13.187967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:13.188398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:13.220969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2c89f724-1cfe-4140-8c6b-c382261ff6e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047746 Aug 31 19:44:13.222146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 681/1368] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:44:14.235228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:14.238697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:14.247202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:14.247735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:14.248179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:14.248940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:14.249442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:14.249905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:14.298152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-65602050-c7a6-4fc7-8c52-564c0324d043 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067466 Aug 31 19:44:14.298985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 688/1369] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:15.311790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:15.314060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:15.320772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:15.321262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:15.321740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:15.322447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:15.323180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:15.323615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:15.355519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4ab8e064-73a5-431b-8f2d-a4c0da2431c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047873 Aug 31 19:44:15.356096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 682/1370] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:16.368564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:16.370842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:16.377988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:16.378538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:16.378957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:16.379683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:16.380147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:16.380580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:16.424871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-39985d0a-7f7b-46c6-9486-43031985f056 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060170 Aug 31 19:44:16.426029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 689/1371] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:17.437495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:17.439712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:17.447100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:17.447595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:17.448296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:17.449020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:17.449523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:17.449967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:17.483205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f72cc226-a010-4ccd-92b8-7b46f172e430 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049648 Aug 31 19:44:17.483841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 683/1372] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:18.497567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:18.500306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:18.508171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:18.508667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:18.509119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:18.509885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:18.510348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:18.510788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:18.542248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7f80fb6b-081f-4cba-8b36-192a32d54eba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049923 Aug 31 19:44:18.542836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 690/1373] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:19.555153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:19.557298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:19.563779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:19.564267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:19.564709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:19.565411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:19.565869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:19.566307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:19.595571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8a2db79e-e148-439f-900c-32899bf5ca16 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045145 Aug 31 19:44:19.596137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 684/1374] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:20.608635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:20.610773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:20.617922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:20.618386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:20.618824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:20.619545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:20.620001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:20.620424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:20.651631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b503a0af-3742-47e6-9e1f-21d365698811 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Aug 31 19:44:20.652209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 691/1375] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:21.665560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:21.667751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:21.674148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:21.674628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:21.675109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:21.675802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:21.676255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:21.676683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:21.707009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-64a9f5c8-a638-45ba-b816-b7627c3f9ef4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Aug 31 19:44:21.707565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 685/1376] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:22.720022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:22.722192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:22.728711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:22.729191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:22.729627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:22.730322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:22.730773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:22.731221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:22.761608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f1923893-2925-4f5c-a47b-8897d3014019 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Aug 31 19:44:22.762158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 692/1377] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:23.773959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:23.776125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:23.782802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:23.783321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:23.783757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:23.784462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:23.784918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:23.785359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:23.815682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bcdb22c-77ea-4d61-af26-7886a51c57c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045833 Aug 31 19:44:23.816242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 686/1378] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:24.828788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:24.830991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:24.838134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:24.838615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:24.839090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:24.839787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:24.840242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:24.840670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:24.870700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-18de34ea-97c5-426e-bac3-9b6044803b3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Aug 31 19:44:24.871297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 693/1379] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:25.883212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:25.885570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:25.892014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:25.892493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:25.892931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:25.893622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:25.894071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:25.894493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:25.924211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3050ea65-a9d8-4c48-9c54-47a1e076fa46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Aug 31 19:44:25.924757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 687/1380] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:26.937078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:26.939255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:26.945841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:26.946321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:26.946760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:26.947474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:26.948184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:26.948656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:26.978095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-761e24fc-cbf3-4611-8af9-866253d0d388 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045008 Aug 31 19:44:26.978641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 694/1381] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:27.990295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:27.992498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:27.998854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:27.999366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:27.999799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:28.000482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:28.000930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:28.001348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:28.031054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b1a14b21-2954-4f91-85b1-60d153999bcc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Aug 31 19:44:28.031659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 688/1382] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:29.043663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:29.045928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:29.052605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:29.053105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:29.053528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:29.054215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:29.054669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:29.055119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:29.085605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-136c4114-9f6f-4c9d-ab61-97d694f25c7d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045808 Aug 31 19:44:29.086176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 695/1383] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:30.097885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:30.100778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:30.107162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:30.108282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:30.108736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:30.109960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:30.110395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:30.110827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:30.141578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d87b1e5e-2828-4546-8291-02de51d3c469 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047745 Aug 31 19:44:30.142475 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 689/1384] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:31.154840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:31.157018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:31.163583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:31.165838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:31.165838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:31.165838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:31.165838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:31.166272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:31.196946 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-80071a81-f1bb-4e89-b390-4dcf773cd24d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046096 Aug 31 19:44:31.197508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 696/1385] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:44:32.209185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:32.211457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:32.217379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:32.217858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:32.218290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:32.219014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:32.219469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:32.219889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:32.254256 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8be0af2e-51e5-4f14-ad6b-38b6f6bfc699 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049147 Aug 31 19:44:32.254812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 690/1386] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:33.266979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:33.269246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:33.276726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:33.277211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:33.277644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:33.278367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:33.278820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:33.279285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:33.309098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0e4e75f9-853d-410b-86df-2c5adaa46751 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Aug 31 19:44:33.309655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 697/1387] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:34.321416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:34.323879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:34.326584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=30 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:34.331290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:34.331766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:34.332201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:34.332890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:34.333336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:34.333756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:34.364452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2d1afc51-cfd5-4d35-89ff-ec21888583ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Aug 31 19:44:34.365009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 691/1388] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:35.377843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:35.380145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:35.387655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:35.388174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:35.388616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:35.389359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:35.389820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:35.390251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:35.420501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bec6259d-47c8-4632-aa80-e960a27425e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046685 Aug 31 19:44:35.421058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 698/1389] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:36.433090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:36.435267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:36.441602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:36.442078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:36.442516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:36.443245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:36.443701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:36.444121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:36.475301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f59d2b0c-8010-4591-9989-4ae37368ad7a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046578 Aug 31 19:44:36.475812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 692/1390] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:37.488089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:37.490271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:37.497033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:37.497513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:37.497956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:37.498645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:37.499123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:37.499550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:37.531681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-da331bbd-5aec-40c4-9c4b-b513e1f95204 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047429 Aug 31 19:44:37.532162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 699/1391] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:44:38.544532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:38.546635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:38.553165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:38.553650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:38.554085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:38.555410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:38.555877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:38.556298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:38.586480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c6476288-37e1-40b9-99af-3a6f817276e1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046011 Aug 31 19:44:38.587063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 693/1392] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:39.599048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:39.601222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:39.603847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:39.608658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:39.609227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:39.609671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:39.610382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:39.610848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:39.611316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:39.643150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f6cbfce0-045d-45c0-bcdb-8947c003fbb2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048176 Aug 31 19:44:39.643717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 700/1393] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:40.655894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:40.658055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:40.665267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:40.665752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:40.666198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:40.666919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:40.667384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:40.667816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:40.697869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1d9fb832-ad21-47ed-9ab7-ff1de3b8d705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Aug 31 19:44:40.698431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 694/1394] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:41.710219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:41.712585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:41.719303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:41.719792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:41.720246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:41.720949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:41.721409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:41.721843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:41.725455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:41.751674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5ed16f17-de48-4825-9cf5-1cc103f7f97d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Aug 31 19:44:41.752249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 701/1395] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:42.764578 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:42.766727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:42.773402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:42.773895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:42.774357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:42.775657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:42.776126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:42.776557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:42.778972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:44:42.806213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-13c954ac-ab2b-4a61-a291-93b55fbf0af1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Aug 31 19:44:42.806806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 695/1396] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:43.818182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:43.821050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:43.828057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:43.828546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:43.828993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:43.829694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:43.830150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:43.830583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:43.862067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3dc32ed7-d914-46ab-b9e4-0427f0a369f9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Aug 31 19:44:43.862633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 702/1397] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:44.874717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:44.876902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:44.878831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:44:44.878991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:44:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:44:44.879992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:44:44.880100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:44:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:44:44.880987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:44:44.881108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:44:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:44:44.891463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:44.891957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:44.892401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:44.893110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:44.893568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:44.893999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:44.926297 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b67ea076-9f1a-4df5-9f8a-a5c953a29d29 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055983 Aug 31 19:44:44.926891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 696/1398] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:45.939225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:45.941346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:45.943397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:44:45.943531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:44:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:44:45.944590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:44:45.944718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:44:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:44:45.953799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:45.954286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:45.954730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:45.955586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:45.956182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:45.956600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:45.988902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-54d9f7b7-78eb-422a-84f5-5b50febfd6b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054137 Aug 31 19:44:45.989473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 703/1399] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:47.001424 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:47.003657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:47.011965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:47.012458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:47.012904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:47.013620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:47.014081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:47.014514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:47.045291 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dab32054-1d7b-4dd4-8e78-a77f53ac9369 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047775 Aug 31 19:44:47.045867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 697/1400] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:48.057754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:48.060080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:48.066541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:48.067101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:48.067561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:48.068263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:48.068723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:48.069175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:48.100860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e5333dfb-90d5-45d6-8d3a-0822f349eced tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 Aug 31 19:44:48.101310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 704/1401] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:44:49.113824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:49.115582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:49.122511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:49.123041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:49.123465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:49.124203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:49.124686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:49.125163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:49.156533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cba420fe-612e-46a5-a78b-9ac5ec345983 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Aug 31 19:44:49.157098 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 698/1402] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:50.168929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:50.171199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:50.178070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:50.178560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:50.179029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:50.179745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:50.180198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:50.180637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:50.212419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-35fc826e-5a47-4766-bbe0-7d7a2fb1c9da tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048100 Aug 31 19:44:50.213001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 705/1403] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:51.225588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:51.227778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:51.234917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:51.239470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:51.239470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:51.239470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:51.239470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:51.240084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:51.268991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f94b5e63-88ef-4199-ad16-b48fd80cdbb5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Aug 31 19:44:51.269559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 699/1404] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:52.284636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:52.286780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:52.293293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:52.293886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:52.294323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:52.295045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:52.295496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:52.295919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:52.326318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3784dfa7-72c7-43c3-9d54-6345b15b50c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045730 Aug 31 19:44:52.326896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 706/1405] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:53.337930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:53.340206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:53.346545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:53.347063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:53.347502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:53.348221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:53.348670 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:53.349091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:53.379167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1e3326ff-8738-4c6f-9045-feff15e8eb1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Aug 31 19:44:53.379714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 700/1406] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:54.392547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:54.394715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:54.401311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:54.401806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:54.402295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:54.403115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:54.403586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:54.404033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:54.435282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ab9cf396-1e04-43d3-b1f3-b11950a00fe6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 Aug 31 19:44:54.435858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 707/1407] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:55.448703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:55.451490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:55.459754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:55.460309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:55.460807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:55.461661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:55.462127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:55.462562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:55.494865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bf044a6c-e107-42b4-a98c-364692c94715 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050584 Aug 31 19:44:55.495459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 701/1408] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:56.507810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:56.509996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:56.517448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:56.517988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:56.518441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:56.519175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:56.519640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:56.520074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:56.551570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8c0fe8bc-712f-469c-addc-f5c71526e444 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Aug 31 19:44:56.552065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 708/1409] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:57.564414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:57.566593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:57.573531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:57.574024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:57.574467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:57.575714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:57.576644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:57.577081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:57.610053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e13677a3-847c-4726-9f1d-66f148c4754b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Aug 31 19:44:57.610549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 702/1410] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:58.623124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:58.625314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:58.631846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:58.632335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:58.632780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:58.633484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:58.633945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:58.634402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:58.664465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-26800405-9c97-4dd8-9c37-c659858186a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Aug 31 19:44:58.665080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 709/1411] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:44:59.677753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:44:59.679839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:44:59.686253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:59.686762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:59.687229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:59.687925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:44:59.688381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:44:59.688840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:44:59.719826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1ecfdedb-05b0-4551-a7e6-b3bcb2492fff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Aug 31 19:44:59.720398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 703/1412] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:44:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:00.733239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:00.735388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:00.741850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:00.742337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:00.742782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:00.743514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:00.744001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:00.744420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:00.774709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-194dd955-c2a8-42dc-b159-61c265537ae1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Aug 31 19:45:00.863798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 710/1413] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:01.787829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:01.789903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:01.797465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:01.797954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:01.798429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:01.799166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:01.799670 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:01.800102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:01.830844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d396c508-4f54-4802-b1b7-a0d50f7ab2d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Aug 31 19:45:01.831435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 704/1414] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:02.842989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:02.845179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:02.851658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:02.856370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:02.856370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:02.856370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:02.856370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:02.856812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:02.884742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-00f3d98b-e498-409b-9612-8164488c01a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045911 Aug 31 19:45:02.885303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 711/1415] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:03.900086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:03.902319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:03.908433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:03.908919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:03.909364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:03.910190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:03.910684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:03.911153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:03.942801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fe2b93fc-a753-4a2d-84bb-3a67af9ae77e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046859 Aug 31 19:45:03.943979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 705/1416] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:04.956180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:04.958341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:04.964922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:04.966201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:04.966733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:04.967561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:04.968104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:04.968468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:04.997954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6fe6cf41-06fb-4c0e-b9e9-31d395f0d713 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045822 Aug 31 19:45:04.998509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 712/1417] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:06.009630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:06.011744 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:06.018978 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:06.019465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:06.019912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:06.020612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:06.021070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:06.021498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:06.051494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6358d11a-6a9d-439c-ae29-b7e9f6729135 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 31 19:45:06.052055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 706/1418] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:07.064239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:07.066398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:07.073124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:07.073614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:07.074059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:07.075459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:07.076022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:07.076343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:07.107140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-831b6a34-1dfd-4a2e-b80c-0402e7757b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Aug 31 19:45:07.107723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 713/1419] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:08.118892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:08.121062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:08.123574 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=32 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:08.128248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:08.128732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:08.129176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:08.129872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:08.130366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:08.130795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:08.161951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6153d6e0-9565-4c0a-ba5d-01455303aacb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Aug 31 19:45:08.162515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 707/1420] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:09.173898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:09.176252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:09.182757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:09.183276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:09.184346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:09.185238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:09.185726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:09.186175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:09.219029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-876643b0-996f-4a7d-9981-ae92e452e3d7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049034 Aug 31 19:45:09.219597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 714/1421] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:10.232206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:10.234374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:10.240845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:10.241328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:10.241763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:10.242460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:10.242937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:10.243367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:10.273981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-66f49117-2488-48ce-ad52-477f0f8d71ee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Aug 31 19:45:10.274555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 708/1422] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:11.287119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:11.289370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:11.296693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:11.297104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:11.297542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:11.298254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:11.298718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:11.299185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:11.330238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-061f279b-69b1-48a2-b52e-bae3da72cdcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047251 Aug 31 19:45:11.330792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 715/1423] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:12.341946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:12.344060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:12.350470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:12.350989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:12.351441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:12.352144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:12.352630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:12.353062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:12.383246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-95f9071b-07d5-48d8-8f9c-2a238c75d9a9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 31 19:45:12.383806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 709/1424] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:13.396741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:13.398928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:13.400863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:13.405666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:13.406150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:13.406592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:13.407331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:13.407794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:13.408226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:13.440451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a7cbef71-a42b-4274-ae8f-1c0a1c572473 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047848 Aug 31 19:45:13.441082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 716/1425] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:14.454896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:14.457075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:14.464276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:14.464805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:14.465425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:14.466494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:14.467191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:14.467722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:14.500869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-02f2d2e1-a1fe-4be7-b343-93f730c3b022 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049915 Aug 31 19:45:14.501456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 710/1426] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:45:15.513371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:15.515582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:15.522112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:15.522596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:15.523066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:15.523759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:15.524218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:15.524644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:15.527083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:15.555696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e06f1a32-b4dd-4905-87ba-7dde92400dd2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Aug 31 19:45:15.556259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 717/1427] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:16.568365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:16.570569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:16.578408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:16.579057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:16.579443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:16.580300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:16.580771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:16.581213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:16.583863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:16.615396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b8844e1c-38f3-403d-bf7b-729e0ea3753d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051066 Aug 31 19:45:16.620521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 711/1428] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:17.627599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:17.629764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:17.636770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:17.637295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:17.637741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:17.638441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:17.638918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:17.639356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:17.670817 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f3dd1c0e-df48-4544-a933-f97081e03738 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Aug 31 19:45:17.671418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 718/1429] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:18.683114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:18.685387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:18.692447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:18.692930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:18.693363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:18.694061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:18.694513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:18.694962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:18.727072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a87c545f-9136-402c-b18a-b59d962b12e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047965 Aug 31 19:45:18.727633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 712/1430] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:19.738643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:19.740880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:19.747686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:19.748214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:19.748660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:19.749434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:19.749900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:19.750333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:19.781765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-138df54f-4df3-41a4-b6b7-d7b1a475ff9c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047098 Aug 31 19:45:19.782341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 719/1431] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:20.794519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:20.796704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:20.803177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:20.803665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:20.804109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:20.804815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:20.805267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:20.805699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:20.838220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-900627b2-3047-4d0d-b225-53e17726cf56 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Aug 31 19:45:20.838783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 713/1432] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:21.850663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:21.852867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:21.859634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:21.860121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:21.860564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:21.861270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:21.861728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:21.862159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:21.893867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7272a682-17d6-46b8-9d99-58d4ab613c9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047124 Aug 31 19:45:21.894748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 720/1433] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:22.906441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:22.908631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:22.915230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:22.915716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:22.916158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:22.916897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:22.917356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:22.918403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:22.947872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-71f85a4a-7875-493d-8be2-f1202ab1f7a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046051 Aug 31 19:45:22.948431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 714/1434] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:23.960963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:23.963232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:23.970750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:23.971273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:23.971722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:23.972431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:23.972897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:23.973335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:24.004921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-85283737-3455-4cd0-bc7c-16e0ac2287c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047884 Aug 31 19:45:24.005490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 721/1435] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:25.017495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:25.019697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:25.026155 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:25.026639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:25.027734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:25.028433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:25.028894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:25.029325 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:25.059568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d3a4ee04-06d7-45a3-b62b-cfe980046a68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046044 Aug 31 19:45:25.060132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 715/1436] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:26.072249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:26.075154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:26.081727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:26.082219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:26.082694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:26.083437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:26.083900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:26.084331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:26.114940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-43f284e5-2035-4eb8-877f-c03aa0690ff2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046912 Aug 31 19:45:26.115518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 722/1437] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:27.127421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:27.129564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:27.136119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:27.136713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:27.137152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:27.137844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:27.138298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:27.138723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:27.169854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-aa547f31-8791-463a-b4d9-24cd84248b82 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Aug 31 19:45:27.179202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 716/1438] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:28.181852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:28.184794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:28.191301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:28.191794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:28.192241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:28.192950 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:28.193416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:28.193852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:28.224249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dda42ebf-20f8-43ec-83ea-11d83f9eea3a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Aug 31 19:45:28.224817 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 723/1439] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:29.239939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:29.243481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:29.251145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:29.251637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:29.252130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:29.252843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:29.253300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:29.253733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:29.284551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-73c29a9d-8115-4229-9681-9e83ec900937 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051437 Aug 31 19:45:29.285135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 717/1440] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:30.296882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:30.299118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:30.305539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:30.306014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:30.306459 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:30.307189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:30.307655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:30.308586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:30.339295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-656fca28-9fdf-4ca4-ad4e-a3e1d3b290d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Aug 31 19:45:30.339855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 724/1441] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:31.351539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:31.353691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:31.360637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:31.361119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:31.361564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:31.362262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:31.362719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:31.363179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:31.393933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-31c8c23f-341f-475b-a3f1-26313e7c6709 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Aug 31 19:45:31.394572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 718/1442] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:32.406169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:32.408562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:32.415088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:32.415575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:32.416019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:32.416763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:32.417841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:32.418366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:32.448990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b1503306-9711-432d-85c9-7ec0f107fc00 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Aug 31 19:45:32.449556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 725/1443] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:33.461513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:33.463761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:33.470438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:33.470963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:33.471433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:33.472138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:33.472599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:33.473027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:33.503958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fc7bb6cf-125f-4839-b830-fb0505dcac0d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046516 Aug 31 19:45:33.504533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 719/1444] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:34.516941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:34.519149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:34.525599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:34.526085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:34.526557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:34.527300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:34.527752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:34.528181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:34.559912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c4524363-9dd4-45df-8cc7-549c6065fee8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046937 Aug 31 19:45:34.560482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 726/1445] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:35.572882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:35.576083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:35.582837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:35.583358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:35.583801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:35.584507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:35.584968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:35.585399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:35.617081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0e8bf072-7353-4c32-b90f-19dd997ab79b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048430 Aug 31 19:45:35.617935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 720/1446] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:36.630236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:36.632457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:36.639156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:36.639649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:36.640095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:36.640809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:36.641295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:36.641729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:36.672039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2f82c03d-aacb-4dbb-b284-0ed05043792a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Aug 31 19:45:36.672604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 727/1447] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:37.684296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:37.686463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:37.693085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:37.693558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:37.693992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:37.694682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:37.695162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:37.695579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:37.727493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8f8c88bf-cc29-49e1-86a0-4daebadc413e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Aug 31 19:45:37.727983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 721/1448] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:38.739951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:38.742229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:38.749617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:38.750105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:38.750552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:38.751290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:38.751754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:38.752189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:38.782530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ac6f3a5b-1f40-4e9d-9929-de7eb4760642 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046620 Aug 31 19:45:38.783106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 728/1449] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:39.795326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:39.797442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:39.799848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=30 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:39.804558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:39.805044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:39.805528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:39.806228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:39.806686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:39.807138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:39.840049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f9890586-8f09-4a09-9967-ba007bd9f084 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048994 Aug 31 19:45:39.840613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 722/1450] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:40.852602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:40.855388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:40.861791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:40.862272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:40.862709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:40.863443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:40.863895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:40.864320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:40.893631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cad39255-ce10-4649-b472-364bf1869ac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Aug 31 19:45:40.894183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 729/1451] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:41.905805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:41.907906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:41.914445 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:41.914966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:41.915412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:41.916125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:41.916631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:41.917199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:41.947458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-50775799-4ea5-43d8-8cbb-4be2d94d7d90 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Aug 31 19:45:41.948516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 723/1452] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:42.960921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:42.963024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:42.969402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:42.969877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:42.970308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:42.971030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:42.971481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:42.971916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:43.001513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67cdd746-e79f-45b4-a4f0-91620ae2dc41 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Aug 31 19:45:43.002067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 730/1453] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:44.014414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:44.016515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:44.023128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:44.023615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:44.024058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:44.024761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:44.025217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:44.025643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:44.057443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-328e532c-3709-4973-bbcd-b5542e45ba46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047476 Aug 31 19:45:44.058136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 724/1454] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:45.069903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:45.072400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:45.075308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=30 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:45.080160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:45.080657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:45.081106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:45.081816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:45.082281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:45.082755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:45.112585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-580837f8-0b0c-4223-9cfa-c9ee4263f3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Aug 31 19:45:45.113151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 731/1455] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:46.125178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:46.127399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:46.133966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:46.134449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:46.134911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:46.135846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:46.136242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:46.136672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:46.168333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e1e7b3e5-a944-45ff-b04e-9dafd7305c75 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Aug 31 19:45:46.168897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 725/1456] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:47.180945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:47.184003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:47.190717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:47.191148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:47.191593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:47.192302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:47.192763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:47.193201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:47.222838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b6dbac43-e8bc-423f-9b71-5971cc2c08d2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 Aug 31 19:45:47.223438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 732/1457] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:48.235470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:48.237610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:48.244437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:48.244935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:48.245374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:48.248294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:48.248294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:48.248294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:48.278579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2af1afd5-838d-4863-983b-5a76ad535e13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047105 Aug 31 19:45:48.279201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 726/1458] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:49.290541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:49.293513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:49.300042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:49.300563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:49.301008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:49.301714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:49.302178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:49.302618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:49.306287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:49.333628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b6432d25-0d1b-4f5e-9a7d-0e1d119a1ea6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047075 Aug 31 19:45:49.334194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 733/1459] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:50.345913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:50.348061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:50.354970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:50.355547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:50.356048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:50.356790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:50.357280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:50.357739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:50.360249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:45:50.387472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-642b05ee-b938-4763-b2e9-36a286ffb6f5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Aug 31 19:45:50.388024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 727/1460] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:51.400080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:51.402632 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:51.409633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:51.410128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:51.410567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:51.411304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:51.411833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:51.412266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:51.442865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f1ffa840-809c-486a-b96a-50189ec7cf33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046799 Aug 31 19:45:51.443438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 734/1461] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:52.454840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:52.457022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:52.464017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:52.464507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:52.464946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:52.465655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:52.466106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:52.466536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:52.497581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-44e7d147-be14-4e21-8850-abb4a67c00e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046663 Aug 31 19:45:52.498158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 728/1462] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:53.509261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:53.512336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:53.518983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:53.519483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:53.519930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:53.520639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:53.521100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:53.521536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:53.551291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a5a0eb11-1ee4-40c8-9be5-5b0bd01cc7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Aug 31 19:45:53.551779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 735/1463] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:54.563805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:54.565840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:54.572475 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:54.573480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:54.573910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:54.574606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:54.575165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:54.575590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:54.604970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7f94c9bf-481f-49d8-b177-36749cfb6a2f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 31 19:45:54.605524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 729/1464] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:55.617203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:55.619512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:55.626085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:55.626582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:55.627060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:55.627775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:55.628237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:55.628670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:55.664461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6a41aad0-f4ed-4b92-84de-cb46d63aee46 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050898 Aug 31 19:45:55.667090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 736/1465] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:56.677778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:56.679958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:56.686780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:56.687298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:56.687739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:56.688442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:56.688899 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:56.689329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:56.720616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-23b6f49c-427d-4f60-bc25-beae3c47c9f0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046852 Aug 31 19:45:56.721177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 730/1466] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:45:57.732445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:57.734759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:57.741308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:57.741793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:57.742240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:57.742988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:57.743482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:57.743917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:57.774397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4e85a4ae-6e4e-48af-9a08-ce99bfd26ded tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 31 19:45:57.774978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 737/1467] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:58.787489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:58.789671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:58.796350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:58.796839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:58.797275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:58.797974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:58.798429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:58.798855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:58.830840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-175730b0-588d-491e-8e60-7c12c2f1d152 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Aug 31 19:45:58.831429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 731/1468] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:45:59.843192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:45:59.845421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:45:59.851932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:59.852424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:59.852870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:59.853606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:45:59.854608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:45:59.855098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:45:59.885703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c723cdc5-315a-44a4-9bad-cdc0361ee560 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046541 Aug 31 19:45:59.886373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 738/1469] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:45:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:00.898197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:00.900477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:00.907037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:00.907555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:00.908001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:00.908703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:00.909165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:00.909598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:00.939565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a86bb35f-d352-4f36-aca4-8b2cc2a3f686 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045360 Aug 31 19:46:00.940123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 732/1470] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:01.952770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:01.955054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:01.961443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:01.961924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:01.962366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:01.963835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:01.964299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:01.964736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:01.993931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-16ec3447-8d3b-4b1b-981c-9ed82c1a12e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 31 19:46:01.994514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 739/1471] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:03.006733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:03.008823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:03.015591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:03.016081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:03.016527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:03.017234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:03.017693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:03.018121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:03.049310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-84661000-f361-4df6-806f-a71f87eca310 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Aug 31 19:46:03.049900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 733/1472] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:04.061886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:04.064110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:04.071156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:04.071656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:04.072106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:04.072822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:04.073286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:04.073718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:04.105407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f56b6851-cc7d-4556-a5c7-a5b4680a1504 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Aug 31 19:46:04.109132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 740/1473] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:05.117967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:05.120962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:05.127516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:05.128001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:05.128448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:05.129157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:05.129614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:05.130045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:05.160336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-959bed02-8ae3-4e55-957e-b502da20f4e7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Aug 31 19:46:05.160905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 734/1474] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:06.172900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:06.175161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:06.182206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:06.182747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:06.183227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:06.183939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:06.184407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:06.184839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:06.215762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-24125269-7c14-472e-820d-8fac335c5efe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046692 Aug 31 19:46:06.216334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 741/1475] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:07.228306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:07.231395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:07.237904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:07.238393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:07.238833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:07.239561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:07.240016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:07.240442 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:07.272056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-81596dfc-d1c4-45ff-af3e-89dc4c55fa9b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047472 Aug 31 19:46:07.272307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 735/1476] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:08.285835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:08.288168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:08.295787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:08.296371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:08.296828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:08.297546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:08.298010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:08.298446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:08.328991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e7167f96-1a92-4071-9981-4808652ed1af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Aug 31 19:46:08.329563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 742/1477] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:09.341506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:09.343755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:09.350369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:09.350855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:09.351335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:09.352038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:09.352494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:09.352924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:09.385341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1054a117-1b90-4552-8c8d-bf2fcccf2df2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047332 Aug 31 19:46:09.386012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 736/1478] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:10.398098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:10.400851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:10.407814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:10.408321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:10.408760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:10.409589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:10.409921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:10.410457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:10.440772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a10404ee-d413-42ed-9007-9093697a714e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Aug 31 19:46:10.441336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 743/1479] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:11.453228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:11.455417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:11.457795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=30 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:11.462505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:11.463690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:11.464292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:11.465004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:11.465471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:11.465906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:11.496397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-072fd0a2-d54c-4fd2-8fab-6e18c6ca3f96 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047136 Aug 31 19:46:11.496974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 737/1480] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:12.508698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:12.511027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:12.517434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:12.517900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:12.518339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:12.519077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:12.519537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:12.519966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:12.550047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-399ae627-19ea-45e8-9a38-72f133d311c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045250 Aug 31 19:46:12.550533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 744/1481] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:13.563827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:13.566053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:13.574051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:13.574539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:13.575023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:13.575740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:13.576200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:13.576634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:13.606419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d1bb0490-4fcd-404b-8063-f077a4967e6e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046612 Aug 31 19:46:13.607012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 738/1482] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:14.618022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:14.620880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:14.626994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:14.627487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:14.627931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:14.628631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:14.629088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:14.629521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:14.659876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f70594d2-4ee3-45db-a1b2-ad05c9a68c3f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Aug 31 19:46:14.660437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 745/1483] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:15.672351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:15.674592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:15.681099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:15.681584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:15.682027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:15.682740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:15.683225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:15.683654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:15.715061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3360467d-16b1-41f4-96d5-9a00be2fd5a6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 Aug 31 19:46:15.715635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 739/1484] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:16.727276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:16.730195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:16.736782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:16.737279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:16.737726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:16.738441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:16.738929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:16.739368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:16.769232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67eb61e8-ebe9-48c3-acb0-83bdf54a8d7c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Aug 31 19:46:16.769792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 746/1485] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:17.781962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:17.784139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:17.791147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:17.791994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:17.792443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:17.793146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:17.793603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:17.794030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:17.825478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c8d31e1e-a4a8-4714-bdf7-50664fd8ad55 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Aug 31 19:46:17.826138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 740/1486] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:18.837977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:18.840311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:18.842734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:18.847617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:18.848195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:18.848702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:18.849408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:18.849867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:18.850299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:18.882596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8a9d382f-c8ec-4b8f-bb52-b054d05518eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048717 Aug 31 19:46:18.883112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 747/1487] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:19.895218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:19.897455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:19.904671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:19.905154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:19.905589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:19.906384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:19.906843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:19.907292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:19.937322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fbd8e4df-2bbc-4d1b-a10a-b69aaf312d8d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046063 Aug 31 19:46:19.937880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 741/1488] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:20.950117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:20.952225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:20.958541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:20.959065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:20.959512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:20.960199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:20.960654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:20.961087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:20.990268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2bc8520a-aebe-4698-a8da-fed12a27897a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Aug 31 19:46:20.990814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 748/1489] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:22.002681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:22.004782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:22.011546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:22.012027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:22.012467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:22.013204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:22.013662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:22.014093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:22.044298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f02b9dbd-2aaa-41a7-b828-b2514a8f1c43 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Aug 31 19:46:22.044864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 742/1490] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:22.762434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:22.762985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:22.769362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:22.769855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:22.770298 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:22.771036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:22.771504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:22.771938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:22.775749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=96 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:22.896620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.objects.instance [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lazy-loading 'services' on Instance uuid 04ae84a4-2370-455d-9fbe-28a42a1f6ece {{(pid=121187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 19:46:23.058012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:23.060195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:23.066766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:23.067281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:23.067721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:23.068476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:23.068932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:23.069368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:23.074217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:23.077469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1153cf9c-b8a0-40fb-95d8-e2a2edc82e6c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece/os-volume_attachments/3f54e6dd-3b9c-4a54-abbd-f839915e23b3" status: 202 len: 0 microversion: 2.1 time: 0.319543 Aug 31 19:46:23.081296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 749/1491] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 31 19:46:22 2022] DELETE /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece/os-volume_attachments/3f54e6dd-3b9c-4a54-abbd-f839915e23b3 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:46:23.104322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bf117572-eaa7-4e86-a865-77e9f3a55611 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050980 Aug 31 19:46:23.104896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 743/1492] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:46:24.116821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:24.120061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:24.126252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:24.126739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:24.127210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:24.127910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:24.128372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:24.128808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:24.159356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9b1640c5-b300-4783-827d-da9083ddc1f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047252 Aug 31 19:46:24.159923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 750/1493] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:25.172512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:25.174649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:25.182625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:25.183137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:25.183572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:25.184256 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:25.184704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:25.185126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:25.216148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d144f458-a71b-4b79-acd9-bd504a9ff249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Aug 31 19:46:25.219234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 744/1494] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:26.229273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:26.231484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:26.234015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:46:26.234167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:46:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments (ip 10.222.0.59) !!! Aug 31 19:46:26.240844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:26.241330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:26.241770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:26.242474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:26.242957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:26.244070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:26.275461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-10a1540d-fa61-4635-958c-cf1c1b520241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050785 Aug 31 19:46:26.276244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 751/1495] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:27.287727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:27.289935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:27.296895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:27.297376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:27.297817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:27.298514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:27.298999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:27.299426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:27.331434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eb6333f3-6f9a-4a4b-8adf-29bb92db3e8a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047535 Aug 31 19:46:27.331952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 745/1496] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:28.344704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:28.346991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:28.354157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:28.354651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:28.355134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:28.355847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:28.356308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:28.356740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:28.388445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4a928eb1-d30a-40d5-a811-973fbc6dfbf6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047670 Aug 31 19:46:28.389027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 752/1497] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:29.400876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:29.403052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:29.409499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:29.409975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:29.410418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:29.411132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:29.411583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:29.412004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:29.442842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-36cb0dc7-9b0e-47b8-acc4-4a57b85aeb0a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Aug 31 19:46:29.443434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 746/1498] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:30.456114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:30.458286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:30.465830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:30.466315 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:30.466783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:30.467521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:30.467981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:30.468407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:30.498588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-403a8e81-20b5-4dcb-b0d6-84f7a500ea4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046410 Aug 31 19:46:30.499194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 753/1499] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:31.511676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:31.513774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:31.520334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:31.520821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:31.521265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:31.521965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:31.522422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:31.522852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:31.554841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3590c21c-c7aa-43ad-8159-f4c306dd405f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047695 Aug 31 19:46:31.555451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 747/1500] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:32.567999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:32.570184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:32.577704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:32.578187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:32.578627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:32.579359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:32.579818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:32.580244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:32.609136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7c3dac1a-1fcc-4d99-b3f6-b03cd6f318e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Aug 31 19:46:32.609699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 754/1501] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:46:33.621698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:33.623853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:33.629788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:33.630264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:33.630701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:33.631431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:33.631879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:33.632298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:33.662388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-46dab020-5205-458d-8a50-f7f1aa41e3b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Aug 31 19:46:33.662973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 748/1502] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:34.674721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:34.676899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:34.683705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:34.684192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:34.684664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:34.685363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:34.685822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:34.686252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:34.716238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-76cc9b9a-3053-4881-b147-5480d11ea1ab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Aug 31 19:46:34.716966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 755/1503] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:35.729536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:35.731758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:35.738257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:35.738741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:35.739220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:35.739952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:35.741643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:35.742093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:35.772500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8d870f24-977e-4189-91c1-dd5b8e7e848d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048633 Aug 31 19:46:35.773050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 749/1504] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:36.785439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:36.787651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:36.794265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:36.794753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:36.795244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:36.795945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:36.796421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:36.796832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:36.827430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c3bed3d5-86db-467c-99c5-1e82bf791f2c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Aug 31 19:46:36.827985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 756/1505] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:37.840436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:37.842568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:37.848971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:37.849450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:37.849890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:37.850581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:37.851064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:37.851494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:37.881361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9be0d04e-899d-4361-b041-6d9c1aed58dd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Aug 31 19:46:37.881920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 750/1506] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:38.893793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:38.896020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:38.902518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:38.903083 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:38.903522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:38.904251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:38.904707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:38.905127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:38.937395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6abeb5e6-fe2d-4792-81ac-faa2dad42a13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Aug 31 19:46:38.937955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 757/1507] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:39.950792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:39.952931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:39.959558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:39.960039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:39.960477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:39.961167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:39.961697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:39.962182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:39.991513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8a105b0b-3b79-44bf-905e-46bd059f2cc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Aug 31 19:46:39.992065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 751/1508] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:41.004890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:41.007142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:41.014731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:41.015249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:41.015698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:41.016401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:41.016900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:41.017333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:41.051029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b826e74d-d768-4095-9704-f0d1901645d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050022 Aug 31 19:46:41.051611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 758/1509] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:42.063546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:42.065709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:42.074294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:42.074776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:42.075242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:42.075946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:42.076407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:42.076820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:42.106655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0c4c4821-0b06-400b-8918-6f6bac73983c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Aug 31 19:46:42.107245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 752/1510] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:43.119071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:43.121212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:43.127688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:43.128173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:43.128616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:43.129312 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:43.129773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:43.130205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:43.159916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-35d07fb1-7997-4636-b35c-0bdbf5bd620a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 31 19:46:43.160470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 759/1511] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:44.172415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:44.174612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:44.177001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=32 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:44.182569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:44.183089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:44.183674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:44.184271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:44.184731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:44.185161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:44.214918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a302df6c-f35f-4244-9af2-a3b5aedf0dc7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046475 Aug 31 19:46:44.215475 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 753/1512] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:45.226521 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:45.229578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:45.236812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:45.237307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:45.237745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:45.238451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:45.238968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:45.239401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:45.270251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d2f84acf-76a2-48f2-8f25-55c80f05d727 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047771 Aug 31 19:46:45.270810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 760/1513] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:46.282010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:46.284224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:46.291636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:46.292123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:46.292566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:46.293275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:46.293732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:46.294167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:46.324619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a06dd343-4365-4699-94fb-2faf5bc6541a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046712 Aug 31 19:46:46.325225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 754/1514] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:47.337367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:47.339510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:47.345937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:47.346424 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:47.346889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:47.347596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:47.348061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:47.348495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:47.379280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8d69d64f-349c-4a06-b885-58f06d1a2454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046582 Aug 31 19:46:47.379847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 761/1515] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:48.391993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:48.394135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:48.401161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:48.401640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:48.402083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:48.402776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:48.403268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:48.403701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:48.433968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9ed8fe77-9af9-4cea-acda-54a94e15380f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 Aug 31 19:46:48.434523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 755/1516] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:49.446619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:49.448709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:49.450997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=30 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:49.455676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:49.456250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:49.456688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:49.457378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:49.457830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:49.458251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:49.487887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d4fcc411-fff7-41bf-abc7-a4e40c1c23e4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Aug 31 19:46:49.488442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 762/1517] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:50.500283 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:50.502451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:50.509495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:50.509965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:50.510399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:50.511135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:50.511587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:50.512006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:50.540733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0d874307-ba39-434c-a4a3-13e417c89fbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Aug 31 19:46:50.541209 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 756/1518] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:51.553362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:51.556218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:51.562776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:51.563282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:51.563719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:51.564407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:51.564861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:51.565285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:51.600862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8604cdbf-2bcd-4e21-be74-f7f974fd6677 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051949 Aug 31 19:46:51.601410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 763/1519] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:52.613915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:52.616095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:52.623446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:52.623930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:52.624371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:52.625069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:52.625524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:52.625947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:52.656346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ba5d2d26-e582-42ba-9b59-ba42335bd615 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046384 Aug 31 19:46:52.656910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 757/1520] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:53.669515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:53.671724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:53.678013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:53.678492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:53.678952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:53.679643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:53.680190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:53.680607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:53.683001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:53.711797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c532cbe0-c8eb-43e3-8e7d-678d13092705 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045552 Aug 31 19:46:53.712388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 764/1521] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:54.723413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:54.725595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:54.733010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:54.733487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:54.733922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:54.734619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:54.735097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:54.735519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:54.767557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-337e28eb-8596-4fee-b0af-00be1491ddc9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048078 Aug 31 19:46:54.768121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 758/1522] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:55.780313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:55.782497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:55.790232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:55.790697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:55.796738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:55.796738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:55.796738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:55.796738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:55.823575 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1a38a6c5-ca32-4dd9-9e22-3b89dda5d55e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Aug 31 19:46:55.824131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 765/1523] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:56.835885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:56.838138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:56.844606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:56.845094 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:56.845535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:56.846236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:56.846699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:56.847151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:56.850737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=96 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:46:56.878247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d19add70-d97f-411d-816c-ac09c18c4c14 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046295 Aug 31 19:46:56.878825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 759/1524] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:57.890648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:57.892847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:57.900105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:57.900590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:57.901031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:57.901734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:57.902193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:57.902623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:57.933560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cda01f27-4316-4c8b-94ce-5363f1b0fab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Aug 31 19:46:57.934119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 766/1525] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:46:58.946892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:46:58.949160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:46:58.956047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:58.956562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:58.957002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:58.957750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:46:58.958211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:46:58.958640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:46:58.989344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1b416749-77ad-4e73-a289-5761a2eee012 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047405 Aug 31 19:46:58.989906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 760/1526] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:00.002723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:00.004919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:00.011843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:00.012324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:00.012764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:00.013471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:00.013933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:00.014366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:00.044470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bd544501-acfb-44dd-b1ff-f043c675cb6a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Aug 31 19:47:00.045040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 767/1527] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:46:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:01.057201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:01.059348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:01.065737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:01.066218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:01.066652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:01.067378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:01.067827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:01.068250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:01.098599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-16358635-68ab-4858-9809-0acc78fe0bf3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045837 Aug 31 19:47:01.099204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 761/1528] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:02.110915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:02.113079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:02.119641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:02.120117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:02.120555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:02.121242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:02.121690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:02.122129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:02.152138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-85909020-c928-441d-a745-a8accdccf60a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Aug 31 19:47:02.152696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 768/1529] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:03.164858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:03.167050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:03.173191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:03.173683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:03.174121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:03.174818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:03.175306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:03.175737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:03.205308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-36c4fdd8-5c34-4ba5-886a-584d24bad490 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Aug 31 19:47:03.205871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 762/1530] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:04.217681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:04.219850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:04.226181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:04.227305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:04.227752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:04.228440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:04.228888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:04.229311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:04.259195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-169e2ac2-f1ce-4f13-b02c-77a14c288112 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 31 19:47:04.259678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 769/1531] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:05.271597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:05.274521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:05.281089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:05.281580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:05.282024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:05.282733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:05.283218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:05.283653 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:05.313518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b9aadaa5-fbb7-4fc3-9c87-f490e2e72863 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045965 Aug 31 19:47:05.314077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 763/1532] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:06.326887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:06.329050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:06.335396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:06.336408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:06.336854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:06.337548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:06.338000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:06.338422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:06.367842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d1fdbc53-f866-4f66-8234-2c345278f101 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Aug 31 19:47:06.368396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 770/1533] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:07.380427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:07.382532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:07.389630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:07.390107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:07.390537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:07.391264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:07.391713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:07.392140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:07.421681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ea413310-727e-4bd6-b11f-fbdb6a156dd6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045348 Aug 31 19:47:07.422233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 764/1534] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:08.433727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:08.435853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:08.442215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:08.442693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:08.443168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:08.443863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:08.444320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:08.445052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:08.474707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c9ec92be-0a3a-4dde-a39b-23a40c191767 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Aug 31 19:47:08.475285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 771/1535] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:09.487274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:09.489366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:09.496795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:09.497277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:09.497719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:09.498421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:09.498891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:09.499334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:09.528738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7d5328fc-a7e7-419b-a47d-f787449a1783 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Aug 31 19:47:09.529295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 765/1536] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:10.541007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:10.543125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:10.549565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:10.550047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:10.550485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:10.551213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:10.551698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:10.552132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:10.582285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9a92960b-ce73-4f97-84e1-75e53bc2f0f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Aug 31 19:47:10.582863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 772/1537] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:11.594793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:11.596967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:11.604296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:11.604781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:11.605219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:11.605912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:11.606377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:11.606807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:11.636279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f66154d4-73ef-4dec-bae9-c63489cdb25e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045461 Aug 31 19:47:11.636828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 766/1538] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:12.649126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:12.651382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:12.657859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:12.658345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:12.658790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:12.659517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:12.659980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:12.660412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:12.689829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d1908273-18dd-491b-a46e-e35f8b3d9915 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045270 Aug 31 19:47:12.690388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 773/1539] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:13.702120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:13.704335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:13.711523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:13.712013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:13.712458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:13.713190 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:13.713645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:13.714075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:13.744804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b3dc10f8-0509-4051-bfff-84138f6fa109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046693 Aug 31 19:47:13.745360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 767/1540] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:14.758386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:14.760757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:14.766788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:14.767309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:14.767780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:14.768481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:14.768941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:14.769373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:14.798711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dbba3206-a0bc-4b9f-94bf-c794e52b2c61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045143 Aug 31 19:47:14.799300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 774/1541] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:15.811179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:15.813501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:15.820576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:15.825946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:15.825946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:15.825946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:15.825946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:15.826428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:15.854064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1e02c013-3fab-4521-8edd-f3c3186948c2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046971 Aug 31 19:47:15.854630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 768/1542] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:16.866316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:16.869202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:16.875654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:16.876143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:16.876589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:16.877291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:16.877754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:16.878186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:16.907571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-93467f3a-66ef-47ce-8852-708c6db4b1a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Aug 31 19:47:16.908120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 775/1543] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:17.919933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:17.922142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:17.924456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=32 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:17.929152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:17.930130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:17.930797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:17.931934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:17.935422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:17.935422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:17.965491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b602a70e-23ef-4a1c-a387-df85cf67a51e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049487 Aug 31 19:47:17.966062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 769/1544] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:18.978256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:18.980461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:18.986882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:18.987378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:18.987824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:18.988518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:18.988973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:18.989400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:19.018854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d1d745e7-9b34-48ff-8c75-11aecb0baf0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Aug 31 19:47:19.019431 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 776/1545] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:20.032237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:20.034337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:20.041810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:20.042301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:20.042746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:20.043494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:20.043954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:20.044389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:20.075957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-86f09e6a-fa70-4155-963e-39d738002d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047806 Aug 31 19:47:20.076538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 770/1546] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:21.089343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:21.091529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:21.098127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:21.098617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:21.099092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:21.099797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:21.100261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:21.100696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:21.131683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4d0834c2-4deb-46b8-87c9-54a26dd69e52 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047010 Aug 31 19:47:21.132279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 777/1547] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:22.143443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:47:22.145589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:22.152749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:22.153237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:22.153672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:22.154368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:22.154821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:22.155275 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:22.185177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c9db87cb-710a-4294-b2cc-2b3eede416ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Aug 31 19:47:22.185740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 771/1548] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 31 19:47:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:47:23.198072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:47:23.200320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:47:23.202799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=32 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:47:23.207523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:23.208009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:23.208450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:23.209175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:47:23.209633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:47:23.210059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:47:23.315782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-788c0bcb-de0d-4fb9-9f9d-3390f1e8f675 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/action" status: 200 len: 41431 microversion: 2.1 time: 0.121932 Aug 31 19:47:23.316455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 778/1549] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 19:47:23 2022] POST /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438/action => generated 41431 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 19:52:23.555846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 19:52:23.556500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=5 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:23.557371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=77 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:23.557907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:52:23.558053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:52:23.559045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:52:23.559180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:52:23.560032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:52:23.560182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:52:23.565245 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:23.565747 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:23.575824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:23.586007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:23.586007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:23.586007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:23.586007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:23.586660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:23.607314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:52:23.854249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-404f46c4-42f3-4b13-af3f-2933d6950ac0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "DELETE /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 204 len: 0 microversion: 2.1 time: 0.300171 Aug 31 19:52:23.854849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 772/1550] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:52:23 2022] DELETE /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:52:23.862436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR oslo.messaging._drivers.impl_rabbit [-] [966a511b-72de-4381-9d8a-e99fd46e459d] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 19:52:23.863189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=87 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:23.864059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:23.864932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:52:23.865963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:52:23.868294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:52:23.868446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:52:23.870276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 19:52:23.870396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:52:23.876286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:23.877002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:23.888442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:23.891192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:23.891192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:23.891192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:23.891192 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:23.891644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:24.237585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:24.246050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4b9b4ef8-018d-4fb7-ae3c-b4790caf8b55 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.385958 Aug 31 19:52:24.248261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 779/1551] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:23 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:25.269298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:25.270003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:25.282263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:25.282263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:25.282263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:25.282263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:25.282638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:25.282638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:25.290916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 39836. Aug 31 19:52:25.472009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:25.480300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-75d5330d-e7a2-4de5-8100-85b8311a06d0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.215492 Aug 31 19:52:25.481505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 773/1552] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:25 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:26.502353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:26.502930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:26.510210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:26.510711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:26.511216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:26.511959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:26.512412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:26.512849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:26.520138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] [966a511b-72de-4381-9d8a-e99fd46e459d] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 39848. Aug 31 19:52:26.644677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:26.652998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c9e10a0b-e5be-4073-a225-fe0c23f75e72 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154591 Aug 31 19:52:26.653567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 780/1553] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:26 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:27.674281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:27.674917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:27.681601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:27.682084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:27.682524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:27.683253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:27.683709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:27.684236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:27.815326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:27.823507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2f3835d4-b541-4508-9188-6535d4dc9131 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153729 Aug 31 19:52:27.824068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 774/1554] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:27 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:28.845149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:28.845781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:28.852228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:28.852717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:28.853162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:28.853864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:28.854327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:28.854764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:28.991041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:28.999911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d1079e11-3d08-44d1-9f1a-5611882c1ce8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159074 Aug 31 19:52:29.000488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 781/1555] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:28 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:30.021056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:30.021665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:30.029601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:30.030084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:30.030526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:30.031261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:30.032400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:30.032400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:30.164840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:30.173034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b0ecec5a-a89e-4fac-b54b-05be73aafc70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155895 Aug 31 19:52:30.173597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 775/1556] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:30 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:31.193858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:31.194504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:31.201080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:31.203741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:31.203741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:31.203741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:31.203741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:31.204176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:31.331476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:31.339716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7714ff44-54f5-4567-b695-7a87dd20754b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149789 Aug 31 19:52:31.340280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 782/1557] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:31 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:32.361923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:32.362591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:32.369178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:32.369675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:32.371123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:32.371850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:32.372320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:32.372766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:32.510103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:32.518735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6cdd2669-5349-40d5-8903-0ef52b481379 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.161250 Aug 31 19:52:32.519334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 776/1558] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:32 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:33.540051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:33.540637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:33.547900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:33.548389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:33.548839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:33.549542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:33.550004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:33.550434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:33.683523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:33.692410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a6a134f2-2526-4248-9b9d-997b62e5a858 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156320 Aug 31 19:52:33.692985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 783/1559] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:33 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:34.713534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:34.714145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:34.720754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:34.721240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:34.721685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:34.722370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:34.723156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:34.723295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:34.854251 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:34.862860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0b489401-cc23-459c-9e25-73d466882842 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153106 Aug 31 19:52:34.863506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 777/1560] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:35.883442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:35.883972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:35.890502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:35.891071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:35.891509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:35.892199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:35.892651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:35.893074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:36.020786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:36.028947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8d23b7e6-b4e7-48e5-9931-098e7df032a6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149362 Aug 31 19:52:36.029520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 784/1561] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:37.050773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:37.051422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:37.057770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:37.058257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:37.058699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:37.059575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:37.059981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:37.060409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:37.187944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:37.196378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3efea462-c894-4d3a-bb51-caf2cdb2871b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149501 Aug 31 19:52:37.196954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 778/1562] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:37 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:38.217667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:38.218356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:38.224772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:38.225251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:38.225693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:38.226379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:38.226833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:38.227281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:38.357319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:38.366098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6cc28c05-8432-4785-9b52-28b95b51192a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152411 Aug 31 19:52:38.366664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 785/1563] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:39.387638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:39.388228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:39.394779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:39.395287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:39.395746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:39.396436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:39.396889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:39.397311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:39.531898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:39.540313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4341d6b2-d7cd-40e8-b02f-67fc43f9f2f6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156575 Aug 31 19:52:39.541114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 779/1564] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:40.562956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:40.563491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:40.570210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:40.570694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:40.571175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:40.571876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:40.572338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:40.572769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:40.707580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:40.715830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e0f832c5-5e8a-402f-bc66-695b71c5e0f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157500 Aug 31 19:52:40.716400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 786/1565] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:41.736923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:41.737548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:41.744038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:41.744514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:41.744943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:41.745629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:41.746183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:41.746608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:41.873462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:41.882120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-079adedb-3654-4362-9e6f-cdee87e80d6b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149029 Aug 31 19:52:41.882682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 780/1566] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:42.904263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:42.904904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:42.911563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:42.912045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:42.912479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:42.913169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:42.913623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:42.914047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:43.039418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:43.047566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-650582b7-9f0a-4141-9b76-37fa7bf99adf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.147202 Aug 31 19:52:43.049004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 787/1567] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:44.069889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:44.070490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:44.077806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:44.078294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:44.078740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:44.079559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:44.080050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:44.080487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:44.210719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:44.219192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3d75b3b0-2362-495d-ac48-ba75efb535e6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153137 Aug 31 19:52:44.220326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 781/1568] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:44 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:45.241753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:45.242371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:45.249073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:45.249549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:45.249979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:45.250664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:45.251804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:45.252230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:45.388413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:45.396837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9825e5c2-8eb0-401f-a558-62b20e91fe37 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158887 Aug 31 19:52:45.397406 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 788/1569] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:46.417682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:46.418272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:46.424731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:46.425206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:46.425638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:46.426324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:46.426772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:46.427221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:46.556344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:46.565345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b392ec80-4d19-4dcf-b995-167e4a6c55b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151403 Aug 31 19:52:46.565924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 782/1570] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:52:47.586281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:47.586960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:47.593422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:47.593899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:47.594335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:47.595076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:47.595532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:47.595965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:47.725882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:47.734098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ae51f039-1e5a-493f-8cfe-5ca81a6318fc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151639 Aug 31 19:52:47.734657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 789/1571] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:48.755550 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:48.756147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:48.762598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:48.763138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:48.763575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:48.764270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:48.764727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:48.765151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:48.898909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:48.907799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-26d0548a-fc6a-4b85-951a-e28411377879 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155479 Aug 31 19:52:48.908699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 783/1572] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:48 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:49.930031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:49.930662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:49.937151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:49.937634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:49.938076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:49.939226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:49.939705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:49.940131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:50.070165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:50.078506 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7dca1c6d-b7bd-47b1-8fed-391d31126b83 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152403 Aug 31 19:52:50.079337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 790/1573] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:49 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:51.099732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:51.100373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:51.106743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:51.107260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:51.107711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:51.108379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:51.108822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:51.109242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:51.243898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:51.252812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d4acb0ec-ceb9-468f-8f57-cf6c75d2a438 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156906 Aug 31 19:52:51.253380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 784/1574] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:51 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:52.273774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:52.274396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:52.280962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:52.281477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:52.281974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:52.282708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:52.283191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:52.283626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:52.412243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:52.420765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3843db67-18bf-4df2-b850-f3e7ffb9821f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151070 Aug 31 19:52:52.421337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 791/1575] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:52 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:53.442021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:53.442646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:53.449093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:53.449588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:53.450034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:53.450733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:53.451221 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:53.451657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:53.582716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:53.591033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c7467486-fc98-465a-88d5-5d06159d91b9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153119 Aug 31 19:52:53.591603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 785/1576] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:53 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:54.613417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:54.614022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:54.616420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=27 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:54.621174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:54.621667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:54.622113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:54.622885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:54.623355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:54.627591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:54.627591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=79 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:54.759452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:54.768330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-21208407-ee47-420d-bb29-e4d147ae42c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159396 Aug 31 19:52:54.768901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 792/1577] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:54 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:55.789567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:55.790199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:55.792268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:55.797142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:55.799783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:55.799783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:55.799783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:55.800090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:55.800521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:55.804635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:52:55.934115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:55.943082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9e41b335-8fe1-4091-83b5-272b0f28da7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157466 Aug 31 19:52:55.943658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 786/1578] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:55 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:56.964387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:56.964997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:56.971691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:56.972185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:56.972626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:56.973347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:56.973806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:56.974239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:57.105042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:57.114243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f4b1dda4-31ec-4840-a893-cba726b9407d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153862 Aug 31 19:52:57.114816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 793/1579] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:56 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:58.136556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:58.137164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:58.144691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:58.145181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:58.145624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:58.146332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:58.146791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:58.147252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:58.275052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:58.283454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6ace9245-ecbe-4610-a90b-3314c2795cd4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151152 Aug 31 19:52:58.284031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 787/1580] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:58 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:52:59.304627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:52:59.305960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:52:59.312401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:59.312888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:59.313587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:59.314391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:52:59.314881 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:52:59.315377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:52:59.442185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:52:59.450783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9b7b49a8-a7e7-4210-b97c-d2f2adc4ce4b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150165 Aug 31 19:52:59.451326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 794/1581] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:52:59 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:00.477552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:00.478131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:00.484435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:00.484915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:00.485342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:00.486746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:00.487203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:00.487628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:00.614045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:00.622270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e0b708e7-bac4-4ff5-95fc-6d3fc9ee3c17 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148658 Aug 31 19:53:00.622845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 788/1582] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:00 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:01.647872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:01.648536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:01.655086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:01.655565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:01.656004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:01.656707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:01.657162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:01.657589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:01.793052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:01.801799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8cd54c38-3b6a-40cd-a526-5307d3b780b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.162467 Aug 31 19:53:01.802372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 795/1583] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:01 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:02.823637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:02.824285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:02.830812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:02.831328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:02.831773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:02.832474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:02.832965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:02.833399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:02.968167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:02.977120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-aca6f4b7-a05d-43bc-a2f7-5d0ec5b5367a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157537 Aug 31 19:53:02.977697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 789/1584] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:02 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:03.999704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:04.000380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:04.007360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:04.007860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:04.008337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:04.009043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:04.009504 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:04.009939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:04.141270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:04.149550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-83c167c9-14d6-4008-9c8b-9e8c539e76fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154541 Aug 31 19:53:04.150119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 796/1585] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:03 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:05.171009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:05.171613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:05.177984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:05.178454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:05.178901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:05.179589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:05.180072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:05.180494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:05.309356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:05.318406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c5e5af32-86d2-4546-a9a4-ab6e58c3fc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151231 Aug 31 19:53:05.318995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 790/1586] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:05 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:06.340100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:06.340807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:06.347850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:06.348332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:06.348767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:06.349473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:06.349921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:06.350345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:06.479820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:06.488044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-62975fc3-5650-4cef-9fb3-f1de1dd15449 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151826 Aug 31 19:53:06.488607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 797/1587] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:06 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:07.508885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:07.509474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:07.515939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:07.516451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:07.516898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:07.518140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:07.518620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:07.519085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:07.653080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:07.661206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-79ea4668-9dc8-47e2-96f1-586495d2c581 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156272 Aug 31 19:53:07.661786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 791/1588] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:07 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:08.682745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:08.683524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:08.690634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:08.691139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:08.691573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:08.692267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:08.692978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:08.693127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:08.831329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:08.840170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5a7b52a8-ea93-4dcc-bd35-f6cd7a805b9f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.161266 Aug 31 19:53:08.840743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 798/1589] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:08 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:09.862025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:09.862630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:09.870119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:09.870604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:09.871090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:09.873148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:09.873148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:09.873148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:09.999781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:10.008545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1d410956-db59-4ccf-b58c-ce2cc026ba1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150393 Aug 31 19:53:10.009061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 792/1590] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:09 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:11.029039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:11.029662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:11.036750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:11.037237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:11.037682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:11.038383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:11.038843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:11.039305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:11.171687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:11.180939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1ba7cda7-e3b0-48bd-b438-6ab5f271cad2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155641 Aug 31 19:53:11.184109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 799/1591] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:11 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:12.204551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:12.205146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:12.211707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:12.212196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:12.212659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:12.213346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:12.213804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:12.214244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:12.354290 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:12.362696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-61e6b3ab-3a6b-4aad-b50c-6b22c7f66259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.162087 Aug 31 19:53:12.364644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 793/1592] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:12 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:13.384587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:13.385205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:13.391876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:13.392368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:13.392813 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:13.393519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:13.393981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:13.395405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:13.526541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:13.534822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f3244a20-2226-4a7b-b5ff-da14109661c8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154074 Aug 31 19:53:13.535689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 800/1593] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:13 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:14.556741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:14.557304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:14.563966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:14.564444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:14.564875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:14.565563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:14.566095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:14.567055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:14.695962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:14.704096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b1fa2410-b5ef-4d85-915c-a87a6b8c32ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151300 Aug 31 19:53:14.704665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 794/1594] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:14 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:15.724533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:15.725156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:15.731607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:15.732176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:15.733711 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:15.734422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:15.734911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:15.737815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:15.866407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:15.874858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f5c270fc-2aba-4143-89ae-684107577a5b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154266 Aug 31 19:53:15.875458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 801/1595] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:15 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:16.899306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:16.899905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:16.906240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:16.906725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:16.907194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:16.907888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:16.908364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:16.908778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:17.036679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:17.044971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bc2e6ec4-e1f2-4945-94ba-97a1a5c84e99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150185 Aug 31 19:53:17.045537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 795/1596] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:16 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:18.066355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:18.067017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:18.073366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:18.073851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:18.074286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:18.075019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:18.075478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:18.075904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:18.204565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:18.213379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5c7771b4-4398-4f02-905c-da9e88e20b2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151138 Aug 31 19:53:18.213943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 802/1597] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:18 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:19.235372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:19.235983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:19.242634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:19.243151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:19.243592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:19.244347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:19.244804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:19.245231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:19.380626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:19.388900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7837352a-e751-44a9-b782-e35dcb5b4abf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157536 Aug 31 19:53:19.389455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 796/1598] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:19 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:20.410428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:20.411227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:20.417613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:20.418106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:20.418582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:20.419323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:20.419790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:20.420227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:20.548729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:20.557765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-11a6271d-c760-4e38-8d40-a8dd69e7bc7c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151184 Aug 31 19:53:20.558369 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 803/1599] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:20 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:21.578892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:21.579533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:21.586980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:21.587465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:21.587909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:21.588605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:21.589063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:21.589490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:21.718435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:21.726934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e2ca9676-4751-442d-b2ba-d6ed89827cb6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151888 Aug 31 19:53:21.727507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 797/1600] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:21 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:22.747725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:22.748371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:22.755484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:22.756018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:22.756460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:22.757147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:22.757602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:22.758079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:22.885949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:22.894232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fd3b02c1-c01e-4bdf-aff2-3a554997fc0c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150421 Aug 31 19:53:22.894807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 804/1601] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:22 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:23.570699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:23.571503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:23.578887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:23.579432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:23.579878 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:23.580615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:23.581074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:23.581505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:23.607801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 19:53:23.836918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-45a96e52-2462-410e-90ef-3ff002133557 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 204 len: 0 microversion: 2.1 time: 0.270689 Aug 31 19:53:23.837616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 798/1602] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 19:53:23 2022] DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 19:53:23.850683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:23.851556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:23.858018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:23.858555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:23.859034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:23.861158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:23.861158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:23.861158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:23.916139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:23.917024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:23.923117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:23.923607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:23.924057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:23.924768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:23.925226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:23.925660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:23.997281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:24.006274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5012e0d3-5e80-445c-9f3d-e78f50435690 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1726 microversion: 2.1 time: 0.159643 Aug 31 19:53:24.007062 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 805/1603] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:24.061674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:24.072202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-56ad7d37-312e-4877-898f-bbbba1726eb0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.160232 Aug 31 19:53:24.072794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 799/1604] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:23 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:25.028367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:25.028982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:25.032253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=28 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:25.036458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:25.036948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:25.037391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:25.038095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:25.038553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:25.039010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:25.041637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=84 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:25.093554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:25.094168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:25.102109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:25.102918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:25.103233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:25.104120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:25.104638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:25.104995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:25.219129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:25.230415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0a6643a1-8d69-4f37-bea1-805afe639c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1726 microversion: 2.1 time: 0.205637 Aug 31 19:53:25.231838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 806/1605] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1726 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:25.257397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:25.266241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-035a38a8-0954-46dc-ad74-415bdcee5531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.176474 Aug 31 19:53:25.267302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 800/1606] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:25 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:26.256408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:26.257924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:26.258090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-c0428fd3-0194-4976-b0d2-523eddb3a153 req-b99382c5-9a1b-41d9-a83a-5d4eb7bc9611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bc06b8-f021-4ee4-ace6-d6cc9a4ac438", "name": "network-vif-deleted", "tag": "18a157bb-7161-4950-9d08-e2f3979e333d"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:53:26.261403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:26.270297 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:26.273603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:26.273603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:26.273603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:26.273603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:26.274018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:26.278914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-c0428fd3-0194-4976-b0d2-523eddb3a153 req-b99382c5-9a1b-41d9-a83a-5d4eb7bc9611 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:26.279940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:26.289762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-c0428fd3-0194-4976-b0d2-523eddb3a153 req-b99382c5-9a1b-41d9-a83a-5d4eb7bc9611 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:26.292038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-c0428fd3-0194-4976-b0d2-523eddb3a153 req-b99382c5-9a1b-41d9-a83a-5d4eb7bc9611 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:26.310806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-c0428fd3-0194-4976-b0d2-523eddb3a153 req-b99382c5-9a1b-41d9-a83a-5d4eb7bc9611 service nova] Creating event network-vif-deleted:18a157bb-7161-4950-9d08-e2f3979e333d for instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 on hv-cinder-85220 Aug 31 19:53:26.318809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-c0428fd3-0194-4976-b0d2-523eddb3a153 req-b99382c5-9a1b-41d9-a83a-5d4eb7bc9611 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209416 Aug 31 19:53:26.320334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 807/1607] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:53:26.329940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:26.330916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:26.337748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:26.338539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:26.339195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:26.340111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:26.340876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:26.341498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:26.369825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:26.381838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a8a40d38-0b29-4501-ac1a-e7fdb06098b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.130659 Aug 31 19:53:26.395917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 801/1608] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:26.485989 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:26.494468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cd98943e-946b-4c4d-9081-2d054ed2bae3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.172769 Aug 31 19:53:26.495070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 808/1609] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:26 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:27.405417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:27.406034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:27.413497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:27.413980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:27.414419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:27.415161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:27.415623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:27.416052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:27.483616 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:27.492553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fd30bbee-7032-4ddc-bf3c-71c105ddca44 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.091575 Aug 31 19:53:27.493131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 802/1610] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:27.515538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:27.516149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:27.522151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:27.522643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:27.523093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:27.523784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:27.524237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:27.524662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:27.654034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:27.663290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-803a3682-4b2b-4b17-a39d-d17da62e9093 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151661 Aug 31 19:53:27.664131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 809/1611] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:27 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:28.513924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:28.514522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:28.521207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:28.521691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:28.522131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:28.522838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:28.523307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:28.523738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:28.584938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:28.593213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ea4e54f0-84a2-4aae-9a42-70d41542edff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083345 Aug 31 19:53:28.593786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 803/1612] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:28.684970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:28.685596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:28.693489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:28.694067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:28.694524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:28.695265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:28.695732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:28.696166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:28.824653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:28.833290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ef5b637b-c2a3-45dd-8d67-e54b729e3ed9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152131 Aug 31 19:53:28.833787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 810/1613] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:28 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:29.613665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:29.614847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:29.621441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:29.621921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:29.622354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:29.623080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:29.623535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:29.623959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:29.685755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:29.694411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7be071a6-d858-44c1-a2cc-8cd52465b188 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084584 Aug 31 19:53:29.694994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 804/1614] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:29.855390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:29.856013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:29.862409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:29.862921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:29.863371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:29.864122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:29.864535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:29.865652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:29.994387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:30.002545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-caaaee34-3b94-41c9-b027-86be71e992d6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151070 Aug 31 19:53:30.003150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 811/1615] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:29 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:30.715295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:30.715928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:30.722549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:30.723072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:30.723517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:30.724510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:30.725122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:30.725556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:30.786346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:30.795015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f3f1d005-759f-42b0-9dc0-284ec815b4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083530 Aug 31 19:53:30.795621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 805/1616] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:31.023602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:31.024145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:31.031395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:31.031887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:31.032328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:31.033062 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:31.033579 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:31.034011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:31.162487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:31.171137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d91c9aee-6af0-4b92-a45b-1faa46b289fe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151498 Aug 31 19:53:31.171731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 812/1617] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:31 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:31.816999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:31.817621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:31.824694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:31.825173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:31.825605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:31.826297 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:31.826749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:31.827201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:31.893912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:31.903087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0b8c5c5a-112b-4acc-8ce5-a1a08de46fb3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090128 Aug 31 19:53:31.903662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 806/1618] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:32.195348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:32.195970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:32.202779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:32.203330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:32.203770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:32.204487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:32.204950 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:32.205386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:32.336876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:32.344998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-64efd4bd-99c7-4d48-8c39-584ee37cc201 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154453 Aug 31 19:53:32.345555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 813/1619] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:32 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:32.923846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:32.924480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:32.931145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:32.939030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:32.939030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:32.939030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:32.939030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:32.939534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:32.995256 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:33.003468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c3b468ea-5ed6-4097-8d39-2ccedb301395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083564 Aug 31 19:53:33.004033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 807/1620] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:33.365662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:33.366287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:33.372880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:33.373368 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:33.373818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:33.374516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:33.375009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:33.375448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:33.506468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:33.515526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ac2c11c2-6bb8-4c7a-b7c4-76e38f91a8f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153775 Aug 31 19:53:33.516097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 814/1621] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:33 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:34.024730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:34.025348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:34.032601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:34.033087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:34.033529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:34.034282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:34.034746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:34.035215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:34.099230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:34.108554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3658dfdd-9000-4160-bd43-b67679680685 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087880 Aug 31 19:53:34.109110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 808/1622] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:34.537218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:34.537848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:34.545332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:34.545819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:34.546261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:34.547017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:34.547454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:34.547892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:34.675688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:34.684094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8fdc85a1-e8ac-42dc-944e-857097bc3f5a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150707 Aug 31 19:53:34.684662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 815/1623] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:35.129553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:35.130170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:35.137706 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:35.138192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:35.138637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:35.139380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:35.139842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:35.140278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:35.200414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:35.208713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d815b2f2-daa3-4b95-bff4-9662081518b4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083009 Aug 31 19:53:35.212801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 809/1624] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:35.705557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:35.706161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:35.712940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:35.713374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:35.713865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:35.714563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:35.715048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:35.715470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:36.113212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:36.121621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-67d7d98c-61fb-4dd7-acb6-e623d9e86d2c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.419929 Aug 31 19:53:36.122189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 816/1625] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:36.232435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:36.233049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:36.239493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:36.239976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:36.240417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:36.241147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:36.241624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:36.242069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:36.305847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:36.314395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-29275a6b-de03-4d11-bcb5-4046484f8526 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086022 Aug 31 19:53:36.314988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 810/1626] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:37.142919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:37.143551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:37.150296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:37.153494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:37.153494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:37.153494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:37.153494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:37.153986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:37.280318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:37.289517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92ba58fa-4bd4-4adf-a6e8-42eac0540e40 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150426 Aug 31 19:53:37.290099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 817/1627] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:37 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:37.337232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:37.337774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:37.344440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:37.344917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:37.345351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:37.346038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:37.346489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:37.346940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:37.407360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:37.416526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d265219e-9b4c-47e0-8a0e-45fecc9496bb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083790 Aug 31 19:53:37.417093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 811/1628] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:38.310883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:38.311518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:38.318418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:38.318949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:38.319408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:38.321032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:38.321505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:38.321937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:38.437444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:38.438327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:38.445577 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:38.446070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:38.446510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:38.447252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:38.447714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:38.448153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:38.455597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:38.464173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d7433173-a72c-49e5-b219-a1127992c141 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157166 Aug 31 19:53:38.464752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 818/1629] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:38.509514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:38.519031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4aa28246-a265-4215-9054-cf6ae61ccce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085343 Aug 31 19:53:38.519626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 812/1630] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:39.485621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:39.486149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:39.492535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:39.493011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:39.493448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:39.494195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:39.494646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:39.495101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:39.540841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:39.541463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:39.548081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:39.548778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:39.549078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:39.549813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:39.550274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:39.550702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:39.613662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:39.622620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8c116f4b-ecae-4fa2-816f-196f2103884e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085865 Aug 31 19:53:39.623866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 813/1631] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:39.626465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:39.635605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8b17af8e-c9c3-4da0-8a05-25e497f42a0a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153858 Aug 31 19:53:39.636414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 819/1632] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:40.644543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:40.645161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:40.652771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:40.653257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:40.653697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:40.654405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:40.654865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:40.655321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:40.656710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:40.657366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:40.664581 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:40.665069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:40.665511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:40.666225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:40.666690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:40.667231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:40.720884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:40.729407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-99ec9a91-9b5f-43d4-8d7d-e1c2c1b8f6d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088753 Aug 31 19:53:40.730195 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 814/1633] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:40.797743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:40.806301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-02dd1fc2-f7bc-47c1-8191-0cb8aa5b27ff tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153454 Aug 31 19:53:40.806887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 820/1634] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:41.749504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:41.750100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:41.756579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:41.757106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:41.757542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:41.758232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:41.758684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:41.759130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:41.820809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:41.827759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:41.828380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:41.829057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-32c14448-9ba0-4161-86c4-9b85c9370aa9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083334 Aug 31 19:53:41.829627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 815/1635] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:41.834454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:41.835473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:41.835907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:41.836599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:41.837049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:41.837471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:41.969324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:41.978479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d8a50d38-fbfd-4215-b77f-733a1f391f65 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154446 Aug 31 19:53:41.979077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 821/1636] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:42.850489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:42.851238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:42.857523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:42.858000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:42.858433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:42.859152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:42.859605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:42.860027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:42.920501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:42.929631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-77abfb8c-d54c-4edc-86c2-60fac1c3916e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082739 Aug 31 19:53:42.930199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 816/1637] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:43.000037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:43.000650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:43.007253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:43.007729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:43.008167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:43.008856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:43.009316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:43.009740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:43.137839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:43.146101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-aa682bc1-003e-48e9-8ca5-1fa3236be62e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149928 Aug 31 19:53:43.146664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 822/1638] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:43.951164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:43.951796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:43.958153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:43.958632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:43.959105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:43.960426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:43.960877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:43.961354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:44.021449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:44.024663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:44.031377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-489d884e-25ee-4ef7-919f-6c65bb723ab9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084136 Aug 31 19:53:44.031955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 817/1639] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:44.167572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:44.168227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:44.174727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:44.175326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:44.175766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:44.176471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:44.176931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:44.177363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:44.192809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:44.310757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:44.319770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e3d0e3b8-b0c3-426e-8afb-8e4137ab4427 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155434 Aug 31 19:53:44.320343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 823/1640] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:44 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:45.053068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:45.053800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:45.060620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:45.061107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:45.061552 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:45.062254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:45.063005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:45.063441 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:45.128609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:45.137300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-72c3d32c-9b56-4c5d-8e9c-9dcddfbd3239 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088451 Aug 31 19:53:45.137871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 818/1641] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:45.341528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:45.342144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:45.348672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:45.349153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:45.349588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:45.350383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:45.350850 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:45.351313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:45.478183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:45.486522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-19e47ee0-651e-47d3-b5f0-fc2021523a44 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148824 Aug 31 19:53:45.487164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 824/1642] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:46.159633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:46.160303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:46.167349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:46.167831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:46.168272 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:46.169054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:46.169522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:46.169953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:46.445645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:46.453925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ba0a9d75-b4af-4748-ab37-7743d1943acd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.298169 Aug 31 19:53:46.454493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 819/1643] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:46.508144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:46.508793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:46.515307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:46.515799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:46.516243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:46.516985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:46.517454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:46.517886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:46.651320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:46.659489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-704bd23b-f521-49fb-a2bb-0e042e4a6d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155830 Aug 31 19:53:46.660061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 825/1644] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:47.476617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:47.477287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:47.483961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:47.484448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:47.484888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:47.485586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:47.486045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:47.486474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:47.550127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:47.558581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e1538a23-2b62-40bd-889f-db6d4d147c99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085854 Aug 31 19:53:47.559446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 820/1645] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:47.680110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:47.681405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:47.688251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:47.688736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:47.689211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:47.689914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:47.690411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:47.690842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:47.827001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:47.835910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0d959362-ed5a-423d-8bcd-ca48a83f245f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159518 Aug 31 19:53:47.836572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 826/1646] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:48.589500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:48.590146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:48.596526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:48.597011 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:48.597450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:48.598145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:48.598601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:48.599070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:48.662387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:48.670819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5d0bebdb-25e9-4bfe-9652-d686ab430a31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086100 Aug 31 19:53:48.671415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 821/1647] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:53:48.857800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:48.858352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:48.864836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:48.865326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:48.866303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:48.867096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:48.867561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:48.867997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:49.009152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:49.017514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4aa39ed7-cdc5-4119-8bff-5f91e6133c73 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.164400 Aug 31 19:53:49.018086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 827/1648] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:48 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:49.692213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:49.692865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:49.699979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:49.700463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:49.700902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:49.701607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:49.702066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:49.702521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:49.763259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:49.771459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e2e98a91-cb83-4d35-82be-b70d24977ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083175 Aug 31 19:53:49.772710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 822/1649] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:50.038615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:50.039205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:50.045292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:50.045781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:50.046260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:50.046988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:50.047596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:50.048034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:50.199641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:50.212694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-18e0b4ef-4ae3-4353-b27e-6edd3bedbafd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.178848 Aug 31 19:53:50.213285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 828/1650] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:50 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:50.795779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:50.796818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:50.807140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:50.807733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:50.808279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:50.808986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:50.809443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:50.810587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:50.876222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:50.884460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-264b4d05-833a-44a3-81e9-fbbc5cafb270 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.093881 Aug 31 19:53:50.885032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 823/1651] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:51.235268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:51.235975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:51.242822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:51.244608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:51.244608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:51.244608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:51.245137 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:51.245600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:51.375278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:51.384226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d555dc26-75ed-4573-aa74-d0d415bd9f07 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152969 Aug 31 19:53:51.384840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 829/1652] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:51 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:51.906817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:51.907465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:51.914174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:51.914662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:51.915135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:51.915845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:51.916305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:51.916740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:51.978052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:51.986204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e72aed0-410d-4d28-8679-30fc4559e032 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083291 Aug 31 19:53:51.986767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 824/1653] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:52.405614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:52.406221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:52.413296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:52.413767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:52.414193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:52.414897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:52.415348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:52.415772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:52.548451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:52.556831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-40fd1b91-38c9-40ed-a15a-33e78ffe8954 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155116 Aug 31 19:53:52.557409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 830/1654] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:52 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:53.008965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:53.009582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:53.016050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:53.016531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:53.016968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:53.017664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:53.018121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:53.018570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:53.079711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:53.088611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9ad4fab2-308c-4c39-bfb9-949769a90f77 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084207 Aug 31 19:53:53.089169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 825/1655] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:53.577860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:53.578462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:53.585014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:53.585501 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:53.585945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:53.586650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:53.587141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:53.587582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:53.722859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:53.727229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ff494be8-9b78-4b6b-bf35-067856cd6ea8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153423 Aug 31 19:53:53.727807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 831/1656] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:53 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:54.109553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:54.110154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:54.116809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:54.117295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:54.117734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:54.118437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:54.118907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:54.119339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:54.180058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:54.188515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b6faef20-aeb8-4036-9320-bb3535601bd1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082799 Aug 31 19:53:54.189086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 826/1657] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:54.748322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:54.748923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:54.755456 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:54.755940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:54.757000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:54.757844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:54.758302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:54.758729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:54.887705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:54.895923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-58a6cd88-c29e-4399-bfbd-32a52152335c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151497 Aug 31 19:53:54.896490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 832/1658] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:54 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:55.210451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:55.211249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:55.217731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:55.218209 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:55.218643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:55.219449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:55.219912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:55.220667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:55.284703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:55.294206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-075e5e65-fb3f-41db-b320-edcaba85fde9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087578 Aug 31 19:53:55.294775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 827/1659] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:55.917673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:55.918266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:55.920922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=54 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:55.925798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:55.930837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:55.930837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:55.930837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:55.930837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:55.931296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:56.060695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:56.070111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b3bd569a-78c4-4e6a-bb99-45d498959391 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156150 Aug 31 19:53:56.070683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 833/1660] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:55 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:56.316232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:56.316849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:56.324031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:56.324536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:56.324956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:56.325656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:56.326112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:56.326541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:56.389718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:56.398112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ecdd1729-6dfa-492b-869b-c5637af22283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086040 Aug 31 19:53:56.398687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 828/1661] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:57.091419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:57.092052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:57.098145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:57.098628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:57.099101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:57.099937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:57.100568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:57.101021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:57.229331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:57.238484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ba3493f4-3725-43a4-b565-f9eb7fa4b1da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150863 Aug 31 19:53:57.239091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 834/1662] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:57 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:57.419787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:57.420368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:57.422755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:53:57.427579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:57.432613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:57.432613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:57.432613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:57.432613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:57.433042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:57.493161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:57.501730 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e2eda86d-8194-4817-881c-fb859a49d192 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086011 Aug 31 19:53:57.502344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 829/1663] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:58.261494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:58.262099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:58.268606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:58.269096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:58.269553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:58.270255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:58.270716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:58.271178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:58.404104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:58.412291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a7b58ac7-ca40-4cd0-9117-5a4cce28db1d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155814 Aug 31 19:53:58.412855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 835/1664] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:58 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:58.522832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:58.523661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:58.529856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:58.530334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:58.530766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:58.531506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:58.531953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:58.532377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:58.593348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:58.602072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4a35ac5c-2eca-4e7a-8cae-344e4ad8e6c7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083277 Aug 31 19:53:58.602640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 830/1665] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:59.433878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:59.434489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:59.441117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:59.441594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:59.442034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:59.442720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:59.443202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:59.443627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:59.573018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:59.581389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92524937-1533-4cbb-9e3d-e95d2d3886c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151400 Aug 31 19:53:59.582075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 836/1666] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:59 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:53:59.622996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:53:59.623625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:53:59.629920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:59.630398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:59.630835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:59.631554 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:53:59.632496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:53:59.632927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:53:59.696324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:53:59.704650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-20532075-817f-4c1f-8684-e929468bc371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085485 Aug 31 19:53:59.705218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 831/1667] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:53:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:00.603787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:00.604438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:00.611063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:00.611550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:00.611994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:00.612694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:00.613156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:00.613613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:00.725594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:00.726423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:00.733230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:00.733814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:00.734323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:00.735146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:00.735606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:00.736039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:00.742810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:00.751095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e273c692-1d6b-4285-adaa-6219a22e9d01 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151598 Aug 31 19:54:00.751672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 837/1668] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:00 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:00.797123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:00.805849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-91f65ee7-6ef8-4e91-8673-d06f94b313ff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084125 Aug 31 19:54:00.806415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 832/1669] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:01.773773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:01.774543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:01.780793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:01.781275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:01.781709 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:01.782400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:01.782852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:01.783297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:01.827383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:01.827993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:01.833877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:01.834366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:01.834808 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:01.836264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:01.836844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:01.837278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:01.898491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:01.906942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c509cfa4-8653-44ba-a374-e9eb7dd2ebed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083889 Aug 31 19:54:01.907546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 833/1670] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:01.918821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:01.927058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6edacc0a-ef54-4c22-9d56-0ff0d194178a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157683 Aug 31 19:54:01.927615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 838/1671] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:01 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:02.927823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:02.928454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:02.935185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:02.935664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:02.936101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:02.936784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:02.937602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:02.938025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:02.948823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:02.949454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:02.955796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:02.956388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:02.956833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:02.957563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:02.958025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:02.958462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:02.966741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:03.017127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:03.026617 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-50e6e3f7-46f1-4c09-b843-e8b2a31a491a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.102257 Aug 31 19:54:03.027236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 834/1672] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:03.088228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:03.096471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ebe2c111-22bd-4292-96a1-af5d83a4a3c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151533 Aug 31 19:54:03.097041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 839/1673] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:02 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:04.049402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:04.050058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:04.059078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:04.059078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:04.059946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:04.060070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:04.061367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:04.061367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:04.119490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:04.120216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:04.126858 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:04.128278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:04.128770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:04.129214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:04.129924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:04.130390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:04.130821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:04.135278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:04.136032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cfcd32e5-3491-4cdb-baab-0ffc250148e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090347 Aug 31 19:54:04.136496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 835/1674] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:04.263757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:04.271914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0314b1dc-67fe-4854-944a-a24e1eba9377 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158026 Aug 31 19:54:04.272543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 840/1675] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:04 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:05.157576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:05.158239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:05.165106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:05.165593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:05.166036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:05.166737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:05.167229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:05.167664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:05.228375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:05.236610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-706b53a2-11ed-4532-bf71-81689b66ed65 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083172 Aug 31 19:54:05.237170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 836/1676] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:05.292548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:05.293166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:05.299785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:05.300267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:05.300704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:05.301397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:05.301914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:05.302347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:05.433254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:05.441751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-96ffa0e7-a543-450d-9099-cd855b20c5e1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153304 Aug 31 19:54:05.442321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 841/1677] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:05 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:06.258337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:06.259214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:06.265661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:06.266138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:06.266581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:06.267344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:06.267806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:06.268237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:06.330589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:06.339400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b27ce9fe-74c0-441d-9a8b-4eb36290eddf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085699 Aug 31 19:54:06.339966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 837/1678] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:06.463993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:06.464598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:06.471021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:06.471502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:06.471934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:06.472624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:06.473073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:06.473498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:06.603508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:06.611815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1bf49212-1e6d-4413-823c-06dc98823228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152316 Aug 31 19:54:06.612378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 842/1679] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:06 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:07.360680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:07.361322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:07.367952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:07.368435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:07.368870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:07.369559 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:07.370008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:07.370431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:07.431029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:07.439544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2e41c38c-168e-472d-a5f1-f82df9f77da2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082842 Aug 31 19:54:07.440104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 838/1680] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:07.632630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:07.633639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:07.640140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:07.640623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:07.641061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:07.641753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:07.643605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:07.644064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:07.776148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:07.784381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d244fc32-aafc-4130-8eac-91d72843a894 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155659 Aug 31 19:54:07.784954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 843/1681] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:07 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:08.460995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:08.461618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:08.468213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:08.468721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:08.469161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:08.469863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:08.470324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:08.470755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:08.534348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:08.543375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e48ee4c0-4cc6-469e-9d7d-e79015133e0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086625 Aug 31 19:54:08.543943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 839/1682] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:08.805181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:08.805889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:08.812313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:08.812798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:08.813230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:08.813917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:08.814370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:08.814792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:08.941518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:08.949613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-790a9a80-31f1-420a-8b77-ec36a0944fa4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149144 Aug 31 19:54:08.950179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 844/1683] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:08 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:09.565252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:09.566506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:09.573153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:09.573637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:09.574074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:09.574774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:09.575252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:09.575680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:09.640222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:09.649345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-01e0cc2e-e1a9-4b38-a1d8-583752060e6b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088162 Aug 31 19:54:09.649660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 840/1684] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:09.971580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:09.972249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:09.979066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:09.979555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:09.979996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:09.980695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:09.981157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:09.981587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:10.117920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:10.126145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-af14016c-6178-4e73-9279-29101aad4aed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158831 Aug 31 19:54:10.126716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 845/1685] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:09 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:10.670191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:10.670798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:10.677187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:10.677667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:10.678137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:10.678917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:10.679382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:10.679803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:10.739890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:10.748320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b5470118-a238-4994-9032-b50275a51f86 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.081974 Aug 31 19:54:10.748893 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 841/1686] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:11.148171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:11.148797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:11.155467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:11.155959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:11.156402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:11.157107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:11.157572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:11.158005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:11.287756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:11.296221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-12239221-d750-4492-9d1b-f2c47b5338c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152320 Aug 31 19:54:11.296912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 846/1687] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:11 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:11.769734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:11.770383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:11.777183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:11.777668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:11.778111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:11.778814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:11.779304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:11.779738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:11.841557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:11.849654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-83274483-18c0-402f-81a5-d8bf01d137d3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083869 Aug 31 19:54:11.850225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 842/1688] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:12.320791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:12.321450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:12.328111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:12.328601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:12.329048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:12.329804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:12.330272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:12.330707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:12.464104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:12.472374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-43b88c67-c72a-491d-a0a7-6ab5e25c8616 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156346 Aug 31 19:54:12.472958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 847/1689] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:12 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:12.871175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:12.871792 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:12.878223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:12.878711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:12.879194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:12.879901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:12.880360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:12.880823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:12.945788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:12.954046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a5de5703-660f-4570-93da-11d0b0bf84a5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086769 Aug 31 19:54:12.954610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 843/1690] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:13.492677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:13.493325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:13.499776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:13.500263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:13.500718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:13.501414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:13.501875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:13.502307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:13.630287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:13.638790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8f8db4b6-7200-4f70-b8d7-905ade1c90e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149962 Aug 31 19:54:13.639392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 848/1691] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:13 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:13.975546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:13.976287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:13.982450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:13.982963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:13.983408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:13.984109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:13.984568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:13.984997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:14.046052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:14.054692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3bf34ff7-f78d-4074-b611-56431304c9a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083251 Aug 31 19:54:14.055285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 844/1692] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:14.660546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:14.661145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:14.668405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:14.668885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:14.669343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:14.670032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:14.670483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:14.670930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:14.798344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:14.807322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1762e960-9672-416d-846a-6d183ed272fa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150605 Aug 31 19:54:14.807892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 849/1693] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:14 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:15.076177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:15.076789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:15.083302 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:15.083779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:15.084209 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:15.085022 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:15.085479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:15.085902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:15.146813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:15.155219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ded3d80f-ed6a-468a-a8f4-a1bf021851c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082828 Aug 31 19:54:15.155795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 845/1694] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:15.828969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:15.829570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:15.836529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:15.837007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:15.837445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:15.838135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:15.838589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:15.839047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:15.969475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:15.977965 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1630b26b-356f-4822-b72f-41146611e852 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152931 Aug 31 19:54:15.978534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 850/1695] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:15 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:16.177310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:16.177875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:16.184229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:16.184704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:16.185133 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:16.185815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:16.186265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:16.186685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:16.250179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:16.260396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5af1ae7b-9b0c-41ef-bd43-5c09f7f97d11 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086938 Aug 31 19:54:16.260973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 846/1696] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:16.999301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:17.000000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:17.007373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:17.008056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:17.008503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:17.009206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:17.009669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:17.010102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:17.141230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:17.149407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-695acc6f-637b-4f7d-a23f-e87d4883a460 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153973 Aug 31 19:54:17.149972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 851/1697] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:16 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:17.282762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:17.283390 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:17.290011 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:17.290523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:17.290960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:17.291662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:17.292111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:17.292534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:17.359764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:17.368685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-868e9459-bbb0-4e60-a9c4-a10fa880ee01 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089740 Aug 31 19:54:17.369263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 847/1698] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:18.170291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:18.170959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:18.177362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:18.177851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:18.178347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:18.179147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:18.179611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:18.180202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:18.390355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:18.396183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:18.398822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:18.399335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:18.399799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:18.400503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:18.400954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:18.401374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:18.463788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:18.472091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-81369440-0dd8-44a1-8b5c-d3c4c13320ea tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085721 Aug 31 19:54:18.472673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 848/1699] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:18.475461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:18.484265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7d2f868c-a2d7-4985-8edd-23a615d58f76 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.317934 Aug 31 19:54:18.484910 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 852/1700] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:18 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:19.493121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:19.493745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:19.500802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:19.501298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:19.501743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:19.502450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:19.502936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:19.503375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:19.504476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:19.505097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:19.512008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:19.512498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:19.512941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:19.513645 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:19.514109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:19.514544 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:19.568454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:19.577115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3f35dc14-b8d6-431d-acea-431e7ab8844e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087926 Aug 31 19:54:19.577937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 849/1701] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:19.646860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:19.655613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-df4aa176-75c1-4f14-82ff-f72fc0a4ae70 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154872 Aug 31 19:54:19.656171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 853/1702] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:19 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:20.599091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:20.599710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:20.606949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:20.607438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:20.607879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:20.608583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:20.609047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:20.609480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:20.670213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:20.677314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:20.677921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:20.679097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-87d3f0d7-9031-4713-826f-2338f40f1aa3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083184 Aug 31 19:54:20.679963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 850/1703] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:20.684757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:20.685238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:20.685671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:20.686373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:20.687094 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:20.687523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:20.819317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:20.827495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c096af93-a518-4167-b1d0-ef67f488402c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153942 Aug 31 19:54:20.828049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 854/1704] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:20 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:21.701163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:21.701755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:21.708134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:21.708610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:21.709043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:21.709731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:21.710181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:21.710608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:21.713145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:21.774535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:21.782865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e55509a0-53f6-4b22-965f-741f11f9e579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085832 Aug 31 19:54:21.783469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 851/1705] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:21.849102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:21.849740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:21.856184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:21.856669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:21.857092 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:21.857778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:21.858230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:21.858700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:21.986206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:21.995191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b3aa50d8-c01e-414f-86c1-317d892efdb3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149890 Aug 31 19:54:21.995748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 855/1706] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:21 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:22.803255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:22.803946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:22.810400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:22.810908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:22.811356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:22.812310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:22.812769 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:22.813199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:22.875583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:22.884537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1fa1424f-aa4c-4a8c-84e9-96654222835e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085243 Aug 31 19:54:22.885131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 852/1707] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:23.016541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:23.017233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:23.024541 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:23.025064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:23.025511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:23.026557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:23.027072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:23.027520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:23.155430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:23.157597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:23.164486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fb2f9bca-5d3b-4436-a516-ea4f49e8f4c1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151862 Aug 31 19:54:23.165051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 856/1708] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:23 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:23.905541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:23.906137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:23.913271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:23.913759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:23.914191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:23.914904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:23.915362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:23.915791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:23.979287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:23.987604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0e709fa6-f453-4b6e-bba9-0adcdcf5a625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085875 Aug 31 19:54:23.988176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 853/1709] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:24.185928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:24.186516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:24.193377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:24.194397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:24.194926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:24.195647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:24.196100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:24.196540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:24.328032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:24.337036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f8280605-18ae-4e85-91a4-81c614bc1fbd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155414 Aug 31 19:54:24.337598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 857/1710] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:24 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:25.008432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:25.009191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:25.015436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:25.015923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:25.016359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:25.017052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:25.017511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:25.017935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:25.078599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:25.086961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c18c28ec-3a1a-4f58-8916-415f18b62cf0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082448 Aug 31 19:54:25.087531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 854/1711] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:25.357719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:25.358347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:25.364807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:25.365298 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:25.365768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:25.366476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:25.366972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:25.367412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:25.494811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:25.503056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-313618a4-39ec-47af-bb57-1321898cba99 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149241 Aug 31 19:54:25.503623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 858/1712] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:25 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:26.108496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:26.111394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:26.116002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:26.116587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:26.117106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:26.117873 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:26.118330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:26.118760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:26.182557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:26.190968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-044bcb3c-f456-4a83-97f4-ecc146ea1ad0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086436 Aug 31 19:54:26.191535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 855/1713] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:26.524178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:26.526324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:26.526801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:26.531518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:26.532003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:26.532448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:26.533161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:26.533624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:26.534386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:26.670071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:26.679147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-739e18ff-5da4-44e7-8e8b-2393bb2b7259 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158928 Aug 31 19:54:26.679726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 859/1714] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:26 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:27.213231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:27.213883 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:27.220371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:27.220852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:27.221293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:27.221989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:27.222447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:27.222888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:27.284543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:27.293397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-88ff4541-5312-481c-891d-2b7b67aa70ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084822 Aug 31 19:54:27.293983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 856/1715] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:27.700990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:27.701602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:27.708025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:27.708513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:27.708955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:27.709773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:27.710238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:27.710665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:27.843239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:27.851553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a2b6f3d1-5faf-4d81-a129-ddf457f193d4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154417 Aug 31 19:54:27.852110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 860/1716] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:27 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:28.314083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:28.314696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:28.317008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:28.322014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:28.322496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:28.322971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:28.323672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:28.324131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:28.324562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:28.386006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:28.394193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c3a554b9-66e2-4d6c-9b50-d6eb1a2f18f6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084223 Aug 31 19:54:28.394763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 857/1717] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:28.872671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:28.873300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:28.880077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:28.880570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:28.881042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:28.881866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:28.882335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:28.882774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:29.010050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:29.018309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4a3f5cf0-d191-4cfe-a118-7ba30c37ad3f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149544 Aug 31 19:54:29.018907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 861/1718] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:28 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:29.416395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:29.417030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:29.423594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:29.424079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:29.424513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:29.425218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:29.425663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:29.426086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:29.489944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:29.500029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-220aa0b6-58e2-4fdf-9508-e333e12ff3c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088036 Aug 31 19:54:29.500838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 858/1719] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:30.041115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:30.041744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:30.048556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:30.049053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:30.049500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:30.050206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:30.050675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:30.051141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:30.184941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:30.194272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c5e7c94e-616d-40d9-bc48-76e475de6aa7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157621 Aug 31 19:54:30.194797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 862/1720] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:30 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:30.520607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:30.521225 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:30.528675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:30.529161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:30.529606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:30.530305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:30.530767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:30.531229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:30.596860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:30.605456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9f98fc4a-0941-49ad-8c96-9f15774df92a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088743 Aug 31 19:54:30.606030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 859/1721] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:31.262349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:31.263033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:31.268905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:31.269391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:31.269825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:31.270517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:31.271004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:31.271434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:31.402435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:31.411087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8292f6c1-1a50-4fc4-8352-ec0a5db0802c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.199800 Aug 31 19:54:31.411643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 863/1722] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:31 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:31.627257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:31.627924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:31.635881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:31.636367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:31.636811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:31.637520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:31.637980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:31.638412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:31.701642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:31.710172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3292bc5f-0b88-4d03-a241-19a7f4270c58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086778 Aug 31 19:54:31.710745 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 860/1723] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:32.432004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:32.432627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:32.439483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:32.439973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:32.440419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:32.441123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:32.441592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:32.442026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:32.574717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:32.582919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9d77c140-2d63-44a3-8338-30790bc6c1cb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154794 Aug 31 19:54:32.583480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 864/1724] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:32 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:32.731410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:32.731965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:32.738446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:32.739088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:32.739526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:32.740220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:32.740794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:32.741218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:32.803657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:32.812476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-08bbbe22-3eff-42ae-baac-caf614e023e5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085097 Aug 31 19:54:32.813047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 861/1725] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:33.605648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:33.606268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:33.612851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:33.613343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:33.613794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:33.614510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:33.615006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:33.615445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:33.751091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:33.759868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3a4804af-a9fc-4d66-8fef-a9ed82e9e148 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158127 Aug 31 19:54:33.760446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 865/1726] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:33 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:33.834896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:33.835657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:33.842285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:33.842767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:33.843235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:33.843934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:33.844386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:33.844814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:33.907657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:33.916741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0b4996ac-1426-41b3-8dff-0a1e4b11c720 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086340 Aug 31 19:54:33.917310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 862/1727] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:34.781216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:34.781823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:34.788790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:34.789274 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:34.789713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:34.790416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:34.790894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:34.791336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:34.920948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:34.929624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ddecc203-7154-47b9-b741-4382c043df24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152340 Aug 31 19:54:34.930179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 866/1728] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:34.937788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:34.938409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:34.944812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:34.945299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:34.945741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:34.946447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:34.946932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:34.947368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:35.011419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:35.019635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ed352fbe-43e0-4cbf-9a3c-7d46c8798153 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085942 Aug 31 19:54:35.020201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 863/1729] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:35.951652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:35.952195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:35.958625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:35.959150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:35.959601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:35.960405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:35.960979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:35.961420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:36.041234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:36.041851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:36.048990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:36.049472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:36.049906 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:36.050604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:36.051079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:36.051572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:36.089011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:36.097355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c8f7728e-e5f5-4f5c-8e75-48fb1f4468c9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149621 Aug 31 19:54:36.097930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 867/1730] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:36.113652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:36.122751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e1c8d4bd-ecd6-4ac1-bd20-06b3bf27f50d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085542 Aug 31 19:54:36.123343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 864/1731] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:37.117458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:37.118074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:37.124693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:37.125184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:37.125622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:37.126316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:37.126775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:37.127236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:37.145319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:37.146422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:37.155848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:37.156334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:37.156771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:37.157472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:37.157959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:37.158386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:37.221155 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:37.229827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-98ec1ad5-3329-4f68-8fc6-6d6514a13a2b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089583 Aug 31 19:54:37.230410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 865/1732] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:37.257619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:37.270559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-57774087-d585-49b2-a89d-f6f5eada98f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152531 Aug 31 19:54:37.270559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 868/1733] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:37 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:38.250639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:38.251271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:38.258291 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:38.258776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:38.259261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:38.260046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:38.260507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:38.260942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:38.291244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:38.293688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:38.298839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:38.299418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:38.299867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:38.300588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:38.301060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:38.301499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:38.323846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:38.331932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f36b31bd-8971-48fd-baf5-447ac44bdb21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085164 Aug 31 19:54:38.332507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 866/1734] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:38.436382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:38.444868 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-04af2330-a8a2-46b4-a39c-95198d9ec1cf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157715 Aug 31 19:54:38.445571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 869/1735] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:39.353150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:39.353743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:39.360309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:39.360793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:39.361228 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:39.361932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:39.362387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:39.362842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:39.427603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:39.430527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:39.437324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0fdabcb9-8eb3-4f3a-b061-8da46d06dbad tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088582 Aug 31 19:54:39.442666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 867/1736] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:39.465831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:39.466494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:39.472978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:39.473468 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:39.473915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:39.474622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:39.475118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:39.475555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:39.607033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:39.615388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-07b8a9e3-806e-4bd3-adaa-53bb734620d7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153542 Aug 31 19:54:39.615961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 870/1737] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:40.458975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:40.459618 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:40.466169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:40.466650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:40.467124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:40.467818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:40.468271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:40.468697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:40.529901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:40.538087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-69d46c8f-ed34-46c6-8e8f-fc8fb8272e5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083248 Aug 31 19:54:40.539199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 868/1738] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:40.637293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:40.637887 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:40.644282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:40.644773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:40.645212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:40.645909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:40.646367 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:40.646796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:40.779639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:40.788097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fe81699b-fc20-469b-a328-09b03623b210 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154577 Aug 31 19:54:40.789590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 871/1739] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:41.558353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:41.558946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:41.565548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:41.566025 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:41.566457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:41.567179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:41.567630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:41.568049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:41.629013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:41.638079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f950b9e5-023c-422f-882c-84cf87768c32 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083635 Aug 31 19:54:41.638639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 869/1740] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:41.810785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:41.811375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:41.817957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:41.818449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:41.818908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:41.820417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:41.820909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:41.821344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:41.948404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:41.956674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-790113b1-849c-4713-ad5c-5b837769d26c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149851 Aug 31 19:54:41.957232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 872/1741] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:42.660036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:42.660682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:42.667947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:42.668431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:42.668871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:42.669570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:42.670028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:42.670459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:42.735655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:42.744587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-469b3d43-ca3f-4765-9fa2-0f42f8da3bfa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088423 Aug 31 19:54:42.745153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 870/1742] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:42.977613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:42.978185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:42.984578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:42.985058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:42.985494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:42.986183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:42.986640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:42.987097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:43.002320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:43.116178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:43.125029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-09d20820-a5b0-4978-964d-c1eb614e5544 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151410 Aug 31 19:54:43.125592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 873/1743] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:43.765816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:43.766429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:43.773096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:43.773583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:43.774028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:43.774838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:43.775229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:43.775664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:43.840923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:43.849291 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-395bc02c-06ef-4321-99e1-5013c50092a4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087450 Aug 31 19:54:43.849867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 871/1744] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:44.145790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:44.146520 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:44.154170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:44.154732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:44.155281 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:44.156126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:44.156587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:44.157021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:44.291311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:44.299480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-324fa9f5-64bc-4d8e-bee0-a700a1255afe tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157624 Aug 31 19:54:44.300039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 874/1745] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:44 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:44.870743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:44.871411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:44.877807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:44.878285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:44.878719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:44.879484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:44.879937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:44.880359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:44.941058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:44.949723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-87bec3a3-de08-467b-812f-e85a00de8d04 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083348 Aug 31 19:54:44.950300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 872/1746] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:45.319938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:45.320566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:45.327187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:45.327680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:45.328127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:45.328829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:45.329299 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:45.329731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:45.457517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:45.466927 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-66c7c510-f94e-488d-a761-52f5a48a85c7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150970 Aug 31 19:54:45.467546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 875/1747] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:45.971411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:45.971976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:45.978677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:45.979193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:45.979639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:45.980338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:45.980803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:45.981238 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:46.045018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:46.053163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bff1233f-ac5e-40f9-9c4b-15a24dad8ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085777 Aug 31 19:54:46.053748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 873/1748] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:46.488792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:46.489417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:46.496652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:46.497148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:46.497594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:46.498302 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:46.498771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:46.499237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:46.630356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:46.638860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ec252fb8-14e1-409b-91b1-f75926f38a2d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153994 Aug 31 19:54:46.639449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 876/1749] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:47.075001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:47.075610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:47.082036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:47.082503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:47.082971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:47.083672 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:47.084133 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:47.084565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:47.147267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:47.156565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-04229658-bb56-4625-9bfe-b62694360009 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085720 Aug 31 19:54:47.157130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 874/1750] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:47.660061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:47.660647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:47.667476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:47.667969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:47.668417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:47.669125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:47.669590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:47.670026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:47.798428 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:47.807478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cfdcf337-b26a-4dc0-a9ab-c51b53565f43 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151425 Aug 31 19:54:47.808054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 877/1751] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:48.178485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:48.179158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:48.186294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:48.187077 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:48.187519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:48.188218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:48.188669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:48.189101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:48.253707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:48.262305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0e897ccb-4293-44ce-8da5-87315693c1fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087598 Aug 31 19:54:48.262954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 875/1752] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:48.830435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:48.831064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:48.838486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:48.839003 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:48.839451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:48.840157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:48.840619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:48.841053 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:48.970759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:48.979089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-076d1291-0e93-4c3a-b67f-532c29486566 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153030 Aug 31 19:54:48.979657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 878/1753] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:48 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:49.283268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:49.285528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:49.290781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:49.291330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:49.291775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:49.292483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:49.292944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:49.293375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:49.356461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:49.364750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8952fc02-20f0-4803-a9ab-2cc66b77617b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085461 Aug 31 19:54:49.365317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 876/1754] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:49.999812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:50.000371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:50.006820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:50.007394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:50.007784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:50.008484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:50.008953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:50.009449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:50.137130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:50.145231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ff1b9eb8-7710-44c9-902b-3e1815eda6bd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149438 Aug 31 19:54:50.145797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 879/1755] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:49 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:50.386970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:50.387585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:50.394102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:50.394585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:50.395045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:50.395759 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:50.396199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:50.396619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:50.457803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:50.467956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8117196f-9510-4f73-b3d7-3620727f31ac tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085547 Aug 31 19:54:50.468516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 877/1756] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:51.167502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:51.168184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:51.175553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:51.176081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:51.176543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:51.177252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:51.177717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:51.178154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:51.336202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:51.346328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a7998fcc-0001-48e7-b25f-ffbca4cb6a8b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.183362 Aug 31 19:54:51.347180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 880/1757] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:51 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:51.489623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:51.490170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:51.497216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:51.497737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:51.498180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:51.498907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:51.499373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:51.499805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:51.566484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:51.575493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7c529814-5625-4b93-98ed-0b541c6eac9d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089827 Aug 31 19:54:51.576099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 878/1758] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:52.368669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:52.369351 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:52.375779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:52.376273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:52.376715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:52.377425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:52.377895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:52.378332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:52.510216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:52.518673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-22110bbb-ced7-48e8-a1f7-4f5a5d01b9aa tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154382 Aug 31 19:54:52.519279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 881/1759] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:52 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:52.596724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:52.597347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:52.604485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:52.604967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:52.605404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:52.606091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:52.606543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:52.606998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:52.669986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:52.678243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9f6566ba-3b4c-4ff8-b795-1390648ddb92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085316 Aug 31 19:54:52.678816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 879/1760] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:53.539625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:53.541262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:53.547712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:53.548202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:53.548647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:53.549349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:53.549814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:53.550251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:53.677271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:53.686844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c63e31fe-8b5f-471a-89f3-aacbe2f65937 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150896 Aug 31 19:54:53.687439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 882/1761] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:53 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:53.700444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:53.701065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:53.707490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:53.707974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:53.708414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:53.709111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:53.709569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:53.710001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:53.772592 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:53.781070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c0cd2e31-3b40-46fb-8650-d81af11e2491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084946 Aug 31 19:54:53.781640 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 880/1762] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:54.708210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:54.708812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:54.715630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:54.716126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:54.716608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:54.717325 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:54.717790 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:54.718229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:54.800834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:54.801449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:54.808683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:54.809202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:54.809638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:54.810339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:54.810794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:54.811503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:54.850990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:54.859944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-08a0ee58-325b-4044-ac69-45f5d03a1ee7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155558 Aug 31 19:54:54.860527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 883/1763] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:54 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:54.874821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:54.883081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2bacda68-cc6d-4f03-8291-08a06e9e71b0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086011 Aug 31 19:54:54.883753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 881/1764] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:55.882420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:55.883138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:55.890073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:55.890555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:55.891019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:55.891713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:55.892168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:55.892592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:55.904487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:55.905103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:55.911271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:55.911695 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:55.912136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:55.912833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:55.913287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:55.913715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:55.976065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:55.984910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5630ca95-de29-4343-97bf-02f4aaa7c820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084204 Aug 31 19:54:55.985487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 882/1765] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:56.028266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:56.036891 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7e27d2b3-e588-4523-8315-0b66ce211945 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158415 Aug 31 19:54:56.037455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 884/1766] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:55 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:57.006490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:57.007280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:57.014384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:57.014889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:57.015345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:57.016047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:57.016510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:57.016940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:57.059661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:57.060427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:57.062574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:57.067226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:57.067714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:57.068155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:57.068860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:57.069321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:57.069749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:57.081942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:57.090491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-23d235dc-9ad3-4c73-8ba0-561adbe00fe9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087797 Aug 31 19:54:57.091101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 883/1767] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:57.199817 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:57.210519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-90a472f9-e6d5-4b76-abf3-5074454b5ca9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155219 Aug 31 19:54:57.211152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 885/1768] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:57 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:54:58.112564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:58.113214 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:58.119882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:58.120365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:58.120807 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:58.121505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:58.121959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:58.122388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:58.137569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:58.184452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:58.192718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4a877ea4-4509-4282-a884-7fb7d1997a02 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084031 Aug 31 19:54:58.193600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 884/1769] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:58.231306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:58.231949 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:58.238401 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:58.238914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:58.239352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:58.240075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:58.240530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:58.240957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:58.372784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:58.381376 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3ecead77-6d01-4741-a3f7-cea71dff6c82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153749 Aug 31 19:54:58.382152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 886/1770] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:58 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:59.215259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:59.215868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:59.218140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:54:59.223149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:59.223802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:59.224394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:59.225387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:59.226126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:59.226708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:59.296982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:59.305558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-64394cc5-3d67-4e01-999b-0324e744cd48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.094685 Aug 31 19:54:59.306130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 885/1771] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:54:59.404950 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:54:59.405571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:54:59.412090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:59.412620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:59.413069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:59.413771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:54:59.414238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:54:59.414692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:54:59.543467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:54:59.551703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cac95ab5-0ffe-4271-9e03-2b655a7c9034 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150616 Aug 31 19:54:59.552278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 887/1772] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:54:59 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:00.326379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:00.327032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:00.333437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:00.333925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:00.334368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:00.335163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:00.335576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:00.336008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:00.396483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:00.405783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2dc19de1-1323-47bf-9dbe-2fc1a9f21cbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083171 Aug 31 19:55:00.406368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 886/1773] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:00.574249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:00.574891 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:00.581366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:00.581853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:00.582293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:00.583028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:00.583491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:00.583923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:00.716833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:00.725076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6d172c15-d54a-4daa-aa6c-9b72231b4bbc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155975 Aug 31 19:55:00.725660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 888/1774] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:00 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:01.427409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:01.427993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:01.434497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:01.435019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:01.435461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:01.436409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:01.436865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:01.437292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:01.503084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:01.511435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4f4f66f2-0249-42c3-a043-06ea67c1a913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087956 Aug 31 19:55:01.511997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 887/1775] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:01.747915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:01.748510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:01.754961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:01.755455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:01.755923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:01.756688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:01.757156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:01.757595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:01.886095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:01.894212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-98df57bc-56cf-4316-b0f7-c3440892d3db tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151720 Aug 31 19:55:01.894771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 889/1776] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:01 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:02.533113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:02.533698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:02.540961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:02.541457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:02.541903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:02.542639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:02.543150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:02.543582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:02.605468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:02.613718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fb331139-551b-4e4a-84bb-259dc4ad21eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084574 Aug 31 19:55:02.614300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 888/1777] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:02.916385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:02.917042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:02.923661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:02.924144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:02.924590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:02.925290 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:02.925750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:02.926179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:02.930070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:03.056388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:03.064932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6a0d622f-9fde-42a4-9b2a-2e7930700c45 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153347 Aug 31 19:55:03.065495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 890/1778] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:02 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:03.636169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:03.636782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:03.643239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:03.643726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:03.644167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:03.644868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:03.645327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:03.645760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:03.707448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:03.716149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0ae92d14-4866-4875-bcba-d5878a985ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084697 Aug 31 19:55:03.716916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 889/1779] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:04.086031 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:04.086701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:04.093205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:04.096484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:04.096484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:04.096484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:04.096484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:04.096925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:04.226518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:04.235499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a4601918-907d-4472-9161-79d6d8bd4a33 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153289 Aug 31 19:55:04.236066 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 891/1780] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:04 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:04.737246 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:04.738030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:04.744571 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:04.745056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:04.745494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:04.746189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:04.746647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:04.747106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:04.811579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:04.819669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-80cbe204-2ea7-4f72-8d78-d8cdf366ea59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086299 Aug 31 19:55:04.820233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 890/1781] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:05.256492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:05.257118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:05.264268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:05.264760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:05.265334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:05.265899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:05.266363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:05.266806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:05.393372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:05.401549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ea1ee7da-417b-4aea-a671-413b1c916580 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149014 Aug 31 19:55:05.402105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 892/1782] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:05 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:05.841548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:05.842165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:05.848753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:05.849242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:05.849685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:05.850491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:05.850982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:05.851417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:05.915623 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:05.924387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-04b3f0e7-801a-4f2c-af94-d77e832dfb4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086717 Aug 31 19:55:05.924957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 891/1783] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:06.422042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:06.422636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:06.429021 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:06.429500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:06.429936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:06.430837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:06.431262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:06.431686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:06.564718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:06.573423 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f22b9d7d-ee93-4d8f-b8d3-68b7cac47f25 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155245 Aug 31 19:55:06.573986 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 893/1784] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:06 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:06.945621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:06.946348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:06.952819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:06.953307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:06.953768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:06.954444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:06.954929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:06.955362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:07.018296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:07.026692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d9fc82d2-fb62-445a-b1c5-1c711fd6c99d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085016 Aug 31 19:55:07.027359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 892/1785] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:07.593912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:07.594510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:07.600926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:07.601408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:07.601842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:07.602668 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:07.603144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:07.603571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:07.729999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:07.738133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-44324dfa-3cfa-4803-b41a-e45f0e4a95ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148104 Aug 31 19:55:07.738708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 894/1786] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:07 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:08.048168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:08.048723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:08.055819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:08.056334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:08.056779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:08.057490 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:08.057950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:08.058381 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:08.122368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:08.130446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-06fc59f6-6714-4998-a452-d540909c631e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086275 Aug 31 19:55:08.131036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 893/1787] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:08.759196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:08.759798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:08.766427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:08.766958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:08.767404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:08.768104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:08.768568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:08.769001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:08.897077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:08.905979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d48265d4-a131-4d11-930b-486aad0159da tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150895 Aug 31 19:55:08.906573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 895/1788] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:08 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:09.153738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:09.154382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:09.160743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:09.161220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:09.161661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:09.162350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:09.162802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:09.163253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:09.226514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:09.234994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a5650d93-7ca9-4bb7-b227-dda514c1767a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086238 Aug 31 19:55:09.235573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 894/1789] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:09.927863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:09.928457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:09.934836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:09.935345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:09.935782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:09.936729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:09.937185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:09.937607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:10.064599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:10.073643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d81829f1-7290-42fb-8d2a-5100453d4b61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149634 Aug 31 19:55:10.074218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 896/1790] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:09 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:10.256102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:10.256661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:10.264082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:10.264564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:10.264998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:10.265689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:10.266136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:10.266560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:10.331555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:10.340066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-993b4f5c-fdda-49d2-880f-917878cc57e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087860 Aug 31 19:55:10.340633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 895/1791] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:11.095432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:11.096074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:11.103283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:11.103766 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:11.104200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:11.104894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:11.105344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:11.105767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:11.236477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:11.244994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8910983d-f9dd-424a-83e0-e94456253fb8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153496 Aug 31 19:55:11.245576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 897/1792] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:11 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:11.361287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:11.361848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:11.368295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:11.368775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:11.369210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:11.369910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:11.370560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:11.370772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:11.432043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:11.440472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3f697a8b-6c8c-40d3-a6ff-08ee27192d3d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083156 Aug 31 19:55:11.441032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 896/1793] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:12.266098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:12.266718 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:12.273254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:12.273753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:12.274191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:12.275007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:12.275897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:12.276561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:12.406583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:12.415624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e33c48ef-52f2-4ead-8728-c148a1b83296 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153375 Aug 31 19:55:12.416226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 898/1794] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:12 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:12.461902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:12.462864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:12.469378 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:12.469905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:12.470324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:12.471064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:12.471534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:12.471954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:12.533186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:12.542483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-00cc377f-8105-4235-bbd1-35d0c9c10b5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084894 Aug 31 19:55:12.543074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 897/1795] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:13.437441 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:13.438051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:13.444378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:13.444859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:13.445675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:13.446853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:13.447337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:13.447763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:13.564093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:13.564802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:13.572056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:13.572539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:13.573060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:13.573771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:13.574235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:13.574661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:13.576886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:13.585160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bd10b2c1-2150-429b-8264-c40dec730f49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151829 Aug 31 19:55:13.585730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 899/1796] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:13 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:13.636295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:13.644492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d3d3c575-99f3-43de-af27-663573802d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084563 Aug 31 19:55:13.645065 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 898/1797] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:14.606096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:14.606748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:14.614022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:14.614511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:14.614984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:14.615743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:14.616233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:14.616665 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:14.666121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:14.666890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:14.673646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:14.674206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:14.674716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:14.675525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:14.676084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:14.676585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:14.742940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:14.751122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ddb51a94-2350-4922-b0d8-5fc9c148535d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089356 Aug 31 19:55:14.751703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 899/1798] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:14.752059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:14.760747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-afeb2c50-c10b-4506-af99-c057c8265169 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159116 Aug 31 19:55:14.761308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 900/1799] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:14 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:15.772033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:15.772742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:15.779223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:15.779707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:15.780149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:15.780853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:15.781347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:15.781580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:15.782064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:15.782321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:15.788685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:15.789678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:15.789802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:15.790407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:15.790865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:15.791323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:15.848220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:15.858280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-73b7ac8c-ddf0-4c16-8878-b17e74e4a7e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090123 Aug 31 19:55:15.858864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 900/1800] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:15.922769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:15.931687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a594d11d-ed30-4ef7-a9ee-7838939171ee tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153945 Aug 31 19:55:15.932250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 901/1801] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:15 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:16.879076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:16.879685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:16.887116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:16.887600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:16.888037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:16.888727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:16.889183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:16.889607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:16.893532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:16.950823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:16.952840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:16.953584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:16.959263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7a01b648-3aed-47e2-a548-ce6436ddaecd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084077 Aug 31 19:55:16.959829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 901/1802] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:16.960206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:16.960763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:16.962200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:16.963069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:16.963611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:16.964116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:17.094732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:17.104522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dce9ad4d-828b-4899-a698-8a78c18cafa6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155683 Aug 31 19:55:17.105295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 902/1803] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:16 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:17.980677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:17.981318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:17.987701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:17.988176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:17.988609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:17.989311 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:17.989742 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:17.990162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:18.051494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:18.060361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a32c820-276a-4b3a-a679-457deca17491 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083693 Aug 31 19:55:18.061183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 902/1804] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:18.126799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:18.127454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:18.134194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:18.134677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:18.135158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:18.135859 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:18.136321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:18.136752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:18.263117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:18.271436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4de5d05c-7279-4fd0-9c9a-9934c268508c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148456 Aug 31 19:55:18.272019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 903/1805] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:18 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:19.082152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:19.082753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:19.089271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:19.089760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:19.090200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:19.090925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:19.091391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:19.091824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:19.157029 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:19.165727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7b3cbc7e-fc60-4324-addb-72147455ce80 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087419 Aug 31 19:55:19.166292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 903/1806] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:19.292627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:19.293249 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:19.299843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:19.300337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:19.300820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:19.301528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:19.301994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:19.302436 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:19.432378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:19.440828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1e7f6059-134a-4d07-b9a8-936064d3049f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152761 Aug 31 19:55:19.441402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 904/1807] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:19 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:20.186823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:20.187465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:20.193849 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:20.194333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:20.195046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:20.196147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:20.196680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:20.197115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:20.256498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:20.265358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-868af4cb-7d45-4159-bf8d-5422c49595df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082649 Aug 31 19:55:20.265939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 904/1808] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:20.461745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:20.462327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:20.468783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:20.469273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:20.469714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:20.470452 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:20.470936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:20.471375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:20.602804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:20.611077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ea8b64f6-07bf-43bc-8ec0-ce97031d6862 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153402 Aug 31 19:55:20.611648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 905/1809] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:20 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:21.285593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:21.286239 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:21.292888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:21.293367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:21.293803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:21.294495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:21.294977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:21.295402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:21.356202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:21.364305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-900f63d0-3925-4a27-8d25-2badfef19c71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082604 Aug 31 19:55:21.364866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 905/1810] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:21.632858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:21.633600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:21.640133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:21.640623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:21.641069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:21.641770 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:21.642235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:21.642670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:21.770968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:21.773211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:21.780587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-52f7b124-2104-4b50-a8f3-4c72a72fe2ae tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151720 Aug 31 19:55:21.781158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 906/1811] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:21 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:22.386922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:22.387529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:22.393887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:22.394365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:22.394797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:22.395507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:22.395962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:22.396380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:22.459996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:22.468358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d65928e2-ff18-4795-9a42-48595396676a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086389 Aug 31 19:55:22.468929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 906/1812] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:22.802154 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:22.802780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:22.810369 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:22.811152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:22.811599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:22.812303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:22.812773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:22.813209 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:22.944338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:22.952883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b18ece53-f8d2-4bcb-98f4-fbc80ecccc7b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154635 Aug 31 19:55:22.953456 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 907/1813] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:22 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:23.489753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:23.490368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:23.496933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:23.497420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:23.497860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:23.498561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:23.499061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:23.499495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:23.562702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:23.571729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5483474c-f5eb-447a-be0e-70297300a331 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086124 Aug 31 19:55:23.572304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 907/1814] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:23.974374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:23.975171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:23.981695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:23.982183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:23.982625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:23.983361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:23.983826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:23.984260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:24.113523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:24.122629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bea65917-89ac-4119-8af9-a8ba3cb7c837 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152100 Aug 31 19:55:24.123245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 908/1815] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:23 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:24.593919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:24.594560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:24.600856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:24.607980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:24.607980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:24.607980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:24.607980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:24.608408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:24.664933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:24.673138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-79e2424a-99a3-4186-aefa-8693f3148997 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083093 Aug 31 19:55:24.676761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 908/1816] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:25.144817 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:25.145500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:25.152730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:25.153214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:25.153653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:25.154354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:25.154811 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:25.155263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:25.284898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:25.293081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c0600468-3282-44e6-a6e5-4e108fe56299 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152389 Aug 31 19:55:25.293660 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 909/1817] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:25 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:25.695353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:25.696092 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:25.702143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:25.704837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:25.704837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:25.704837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:25.704837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:25.705242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:25.766234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:25.774589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-512df370-bcea-43d2-9705-2d9596e80828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083408 Aug 31 19:55:25.775185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 909/1818] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:26.321703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:26.321703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:26.325637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:26.325637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:26.325637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:26.325637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:26.326194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:26.326194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:26.470200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:26.478331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2dda649e-0def-48df-8418-d8057cc024c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.166677 Aug 31 19:55:26.478922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 910/1819] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:26 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:26.795480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:26.796087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:26.802888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:26.803406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:26.803850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:26.804551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:26.805583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:26.806050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:26.867187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:26.875980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a807db77-99cb-4015-b6c4-d802be0f85df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084344 Aug 31 19:55:26.876551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 910/1820] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:27.499573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:27.500191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:27.502271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:27.507606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:27.513047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:27.513047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:27.513047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:27.513047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:27.513590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:27.643350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:27.652530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2f552097-c21a-4b46-935d-80fb2533c557 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156869 Aug 31 19:55:27.653467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 911/1821] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:27 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:27.897699 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:27.898236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:27.905401 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:27.905896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:27.906341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:27.907071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:27.907534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:27.907990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:27.972360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:27.980721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c4d09b5a-eac4-4e18-9c32-9cb81950d2cd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087068 Aug 31 19:55:27.981291 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 911/1822] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:28.674100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:28.674726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:28.682245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:28.682732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:28.683206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:28.683913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:28.684748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:28.685201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:28.817248 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:28.825584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f050624d-9f3a-4e4f-9f3b-1ebf9330a650 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155356 Aug 31 19:55:28.826127 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 912/1823] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:28 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:29.001393 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:29.001957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:29.009026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:29.009511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:29.009950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:29.010650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:29.011129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:29.011558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:29.073163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:29.081440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2665aae7-a2b3-452a-9c5c-1ac6e3c1e28e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083935 Aug 31 19:55:29.082014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 912/1824] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:29.846189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:29.846806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:29.853732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:29.854223 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:29.854674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:29.855400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:29.855941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:29.856287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:29.988889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:29.997701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a374bef6-a9ed-47ae-bb47-970565a10a62 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155459 Aug 31 19:55:29.998266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 913/1825] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:29 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:30.102612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:30.105027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:30.105599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:30.110269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:30.110753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:30.111223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:30.111926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:30.112399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:30.112834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:30.176061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:30.184463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-520217ff-c64e-40d7-beac-7747605d02b3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085857 Aug 31 19:55:30.185040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 913/1826] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:31.020391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:31.021028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:31.027498 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:31.027978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:31.028416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:31.029108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:31.029561 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:31.029985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:31.159403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:31.168214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5f441460-7577-4dfd-9a28-baadd59a753f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151677 Aug 31 19:55:31.168791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 914/1827] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:31 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:31.207934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:31.208549 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:31.217050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:31.217881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:31.218632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:31.219544 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:31.220172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:31.220982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:31.283213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:31.292583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4e4486a3-1c8b-41b6-84bc-cc1be860150c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088391 Aug 31 19:55:31.293162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 914/1828] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:32.189870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:32.190515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:32.197337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:32.197826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:32.198270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:32.199007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:32.199473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:32.199907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:32.313169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:32.313805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:32.320227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:32.320718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:32.321668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:32.322406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:32.322923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:32.323355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:32.328201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:32.336420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ff815e9d-65fa-43a4-b813-2771b6b78c1c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150674 Aug 31 19:55:32.337671 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 915/1829] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:32 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:32.389593 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:32.397844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5457b34f-1cd4-4c33-ba4a-8968bbab7ae7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088843 Aug 31 19:55:32.398412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 915/1830] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:33.359529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:33.360155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:33.366668 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:33.367185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:33.367630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:33.369052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:33.369519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:33.369959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:33.420132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:33.420753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:33.427167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:33.427656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:33.428105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:33.429465 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:33.429939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:33.430433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:33.493348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:33.498670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:33.502017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8361ff04-abc9-4e81-9a51-21c068b4f27d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085823 Aug 31 19:55:33.502604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 916/1831] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:33.507242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-18a6404f-ca27-4acf-b86c-568e059869ce tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151660 Aug 31 19:55:33.507885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 916/1832] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:33 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:34.523937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:34.525106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:34.528751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:34.529502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:34.531566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:34.532057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:34.532504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:34.533208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:34.533665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:34.534095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:34.535926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:34.536418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:34.536874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:34.537670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:34.538045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:34.538480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:34.597443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:34.599661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:34.606659 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b37ebd72-57bd-42dd-9374-dc94aa0fd43b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086777 Aug 31 19:55:34.607273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 917/1833] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:34.674533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:34.683231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c1292e57-56b1-42c3-a964-b9fccf154bd1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158791 Aug 31 19:55:34.683832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 917/1834] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:35.628206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:35.628826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:35.635771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:35.636265 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:35.636711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:35.637410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:35.637870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:35.638301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:35.702318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:35.704951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:35.705565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:35.710994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09fd01be-960f-4257-b565-2db425b79a84 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087059 Aug 31 19:55:35.720402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 918/1835] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:35.720627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:35.720627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:35.720627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:35.720627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:35.721036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:35.721036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:35.847017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:35.856188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1d255830-f39c-4150-a643-cf786349f214 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155191 Aug 31 19:55:35.856822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 918/1836] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:36.733782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:36.734387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:36.740907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:36.741383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:36.741815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:36.742501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:36.742986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:36.743408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:36.807668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:36.816125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6c5e87eb-328a-4890-b309-5cfe775c04c1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086254 Aug 31 19:55:36.816686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 919/1837] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:36.877155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:36.877777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:36.884930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:36.885420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:36.885863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:36.886564 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:36.887073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:36.887513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:37.018757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:37.027669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e44c2522-45cf-456e-820b-77b7b32018b5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154406 Aug 31 19:55:37.028231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 919/1838] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:36 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:37.838169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:37.838788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:37.845151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:37.845632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:37.846071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:37.846772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:37.847251 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:37.847678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:37.910547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:37.919555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f785f754-9860-4dd4-94d2-8363916451e8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085433 Aug 31 19:55:37.920128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 920/1839] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:38.048557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:38.049177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:38.055705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:38.056188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:38.056685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:38.057391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:38.057848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:38.058280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:38.184336 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:38.192753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-11ae8ad7-92a2-4872-b71a-b41e906dd02c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148099 Aug 31 19:55:38.193310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 920/1840] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:38.940894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:38.941521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:38.948728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:38.949207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:38.949646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:38.950343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:38.950797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:38.951249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:39.011900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:39.019989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d6a78997-7e7d-4ba4-bdf0-bf2df297dd95 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082983 Aug 31 19:55:39.020562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 921/1841] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:39.213473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:39.214039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:39.220522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:39.221013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:39.221460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:39.222168 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:39.222642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:39.223108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:39.352966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:39.361815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-174fa582-dc9c-441c-ac30-1b4dc529eb3d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152349 Aug 31 19:55:39.362382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 921/1842] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:40.042912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:40.044667 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:40.050605 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:40.051138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:40.051579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:40.052276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:40.052734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:40.053162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:40.115125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:40.123292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-45fefa45-8de6-469b-9142-d3c2c6f53395 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084442 Aug 31 19:55:40.123866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 922/1843] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:40.383245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:40.384028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:40.391217 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:40.391708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:40.392153 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:40.392860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:40.393326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:40.393760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:40.525384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:40.533585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f2eaec27-ea85-4ab4-b99e-d1495405ada8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154285 Aug 31 19:55:40.534157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 922/1844] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:41.144414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:41.145020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:41.152030 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:41.152505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:41.152937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:41.153624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:41.154074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:41.154492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:41.219316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:41.227494 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d22d1b25-6306-4917-92e1-6aae96f49e92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086963 Aug 31 19:55:41.228054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 923/1845] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:41.555551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:41.556162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:41.562864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:41.563378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:41.563873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:41.564574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:41.565033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:41.565467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:41.580688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:41.694030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:41.703085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c16bf059-53d6-451f-aa30-d4cb29650464 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151547 Aug 31 19:55:41.703670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 923/1846] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:42.249994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:42.250622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:42.256946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:42.257421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:42.257853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:42.258538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:42.259015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:42.259439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:42.320990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:42.329326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6b7df96c-a70a-4037-8bbd-9a45c99c02a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083142 Aug 31 19:55:42.329889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 924/1847] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:42.723540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:42.724186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:42.731314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:42.731802 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:42.732244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:42.732948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:42.733410 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:42.733846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:42.865270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:42.873838 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9d169430-7108-4586-b81e-169832c7d442 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154186 Aug 31 19:55:42.874409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 924/1848] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:43.350305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:43.350939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:43.357800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:43.358326 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:43.358772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:43.359508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:43.359972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:43.360404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:43.421147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:43.429298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6f01a5a3-5a7b-4800-882d-bdde4cfe19ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082862 Aug 31 19:55:43.429860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 925/1849] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:43.895886 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:43.896533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:43.903851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:43.904342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:43.904787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:43.905488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:43.905952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:43.906386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:44.033475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:44.042500 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-062346a8-f0cc-4047-9c1d-e3de84255ed5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150304 Aug 31 19:55:44.043115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 925/1850] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:43 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:44.451365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:44.451986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:44.453954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:55:44.454103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:55:44.455113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:55:44.455233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:55:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:55:44.465982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:44.466483 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:44.466952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:44.467668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:44.468129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:44.468561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:44.532854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:44.540974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0c3b06ad-a7ee-4953-bb8d-48380136daab tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.093580 Aug 31 19:55:44.542310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 926/1851] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:45.063952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:45.064562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:45.066493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:55:45.066622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:55:45.068040 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:55:45.068169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece (ip 10.222.0.59) !!! Aug 31 19:55:45.076622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:45.077113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:45.077547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:45.078245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:45.078702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:45.079158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:45.211321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:45.220275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-97296408-142f-4c38-ae9f-ee669f122018 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.160472 Aug 31 19:55:45.220846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 926/1852] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:45.562561 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:45.563242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:45.569930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:45.570429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:45.570888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:45.571630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:45.572090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:45.573363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:45.636692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:45.644894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fee5d1dc-5d33-476f-992f-4d2fda8a5597 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086489 Aug 31 19:55:45.645397 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 927/1853] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:46.241263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:46.241870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:46.248224 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:46.248707 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:46.249141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:46.249866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:46.250317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:46.250745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:46.377464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:46.385641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-94cb640d-37ed-41e0-aba2-7a79cc997598 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148246 Aug 31 19:55:46.386203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 927/1854] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:46.664856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:46.665472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:46.672104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:46.672583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:46.673021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:46.673713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:46.674168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:46.674629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:46.735285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:46.743370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3dd54d84-3a11-4fa1-b952-653b7ca9b2a1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082401 Aug 31 19:55:46.743935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 928/1855] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:47.405818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:47.406483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:47.413814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:47.414303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:47.414750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:47.415494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:47.415955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:47.416899 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:47.545980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:47.554222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ba2adaa4-54e3-47bc-a107-a45ddc15e6d8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152290 Aug 31 19:55:47.554791 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 928/1856] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:47.764687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:47.765306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:47.771897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:47.772383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:47.772824 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:47.773520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:47.773987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:47.774420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:47.834825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:47.843575 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4b023bc6-e3f6-4121-85a6-a0de5515decd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082762 Aug 31 19:55:47.844146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 929/1857] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:48.576103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:48.576714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:48.583245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:48.583736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:48.584177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:48.584877 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:48.585335 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:48.585763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:48.719358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:48.727528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d656d4d0-8c1e-40ab-b51a-e307486a67b1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155440 Aug 31 19:55:48.728096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 929/1858] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:48 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:48.865236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:48.865823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:48.872278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:48.872754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:48.873184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:48.873863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:48.874342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:48.874761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:48.936123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:48.944261 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ec546f41-dcdc-478c-98ef-328b7d57df61 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082973 Aug 31 19:55:48.944823 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 930/1859] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:49.749684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:49.750370 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:49.757095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:49.757585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:49.758152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:49.758853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:49.759343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:49.759929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:49.886266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:49.894477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-cfa73cdc-5e3b-49ee-a6cd-e2626924c200 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148712 Aug 31 19:55:49.895074 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 930/1860] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:49 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:49.966130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:49.966737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:49.973619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:49.974097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:49.974533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:49.975257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:49.975705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:49.976124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:50.040436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:50.049415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-92ec9d83-15c4-4de9-aac8-d3c3bfb8d16e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087790 Aug 31 19:55:50.049982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 931/1861] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:50.915714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:50.916562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:50.922807 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:50.923318 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:50.923759 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:50.924450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:50.924904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:50.925328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:51.054492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:51.063674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ee13a577-0287-42c5-ad1f-d0a25ccc82bb tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151824 Aug 31 19:55:51.064250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 931/1862] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:50 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:51.070200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:51.070798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:51.077271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:51.077749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:51.078180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:51.078887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:51.079344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:51.079765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:51.141954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:51.150010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-072f3d79-7fde-441f-85db-c2df1fcaf77f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083639 Aug 31 19:55:51.150611 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 932/1863] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:52.084920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:52.085532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:52.092484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:52.093294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:52.093729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:52.094421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:52.094892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:52.095324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:52.178833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:52.179473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:52.186726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:52.187260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:52.187703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:52.188407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:52.188862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:52.189285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:52.226993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:52.235523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a6d7be82-97a1-4997-8b62-a459ec07d4cc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154485 Aug 31 19:55:52.236090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 932/1864] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:52 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:52.250799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:52.259211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-339881fa-f621-4d56-a17f-66e31e74a788 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.092200 Aug 31 19:55:52.259780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 933/1865] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:53.257536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:53.258156 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:53.265843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:53.266350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:53.266961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:53.267856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:53.268398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:53.268856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:53.285259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:53.286489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:53.297083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:53.297569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:53.298008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:53.299506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:53.300361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:53.300800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:53.319821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:53.375059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:53.383601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c836f5f8-65d8-43e9-909c-10aac46901c8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.104369 Aug 31 19:55:53.384178 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 934/1866] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:53.417661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:53.427049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-673e2456-4717-4ef6-a006-024171754779 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.173459 Aug 31 19:55:53.427656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 933/1867] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:53 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:54.406107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:54.406728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:54.413159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:54.413645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:54.414086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:54.414786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:54.415273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:54.415702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:54.455334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:54.455948 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:54.462473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:54.463631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:54.464081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:54.464797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:54.465266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:54.465699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:54.480719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:54.489003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d14f6305-0d6b-43db-93a0-1d7cc7bf40d1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086710 Aug 31 19:55:54.489668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 935/1868] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:54.598605 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:54.607931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-710d0083-e2dc-4839-8e57-9af9fae26bc1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156348 Aug 31 19:55:54.608513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 934/1869] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:54 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:55:55.512429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:55.513028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:55.519870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:55.520357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:55.520797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:55.521492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:55.521944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:55.522382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:55.583993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:55.592375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-881c34a9-1261-4ea2-995e-8cbaa34b089e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084481 Aug 31 19:55:55.592939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 936/1870] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:55.629177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:55.629801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:55.636552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:55.637041 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:55.637483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:55.638188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:55.638652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:55.639147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:55.769530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:55.778262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-99e92ead-f59b-4919-b999-551634af6a66 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153041 Aug 31 19:55:55.778832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 935/1871] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:55 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:56.615775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:56.616403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:56.623550 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:56.624036 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:56.624478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:56.625172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:56.625631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:56.626064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:56.687482 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:56.695771 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-455957a1-adae-4655-8ba0-cfc0ed6ebe89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084026 Aug 31 19:55:56.696344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 937/1872] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:56.800090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:56.800746 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:56.807060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:56.807562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:56.808012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:56.808720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:56.809185 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:56.809620 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:56.940269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:56.948488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-62378361-b51f-4032-ba28-b75fa6aa1e57 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152479 Aug 31 19:55:56.949055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 936/1873] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:56 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:57.717344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:57.717963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:57.724409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:57.725027 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:57.725334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:57.726035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:57.726491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:57.726952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:57.788034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:57.796495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8567af46-fe7b-4a2a-b0ca-96fedab3d448 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083512 Aug 31 19:55:57.797064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 938/1874] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:57.970165 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:57.970721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:57.973068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:55:57.978087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:57.978577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:57.979059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:57.979892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:57.980470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:57.980931 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:58.108578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:58.116652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e7dfaf50-7338-46e4-a826-159963f21b58 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150455 Aug 31 19:55:58.117212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 937/1875] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:57 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:58.817712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:58.818316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:58.824835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:58.825383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:58.825758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:58.826456 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:58.826937 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:58.827370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:58.897979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:58.906836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-20c2c523-009a-46fd-8754-d0e771de835b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.093029 Aug 31 19:55:58.907419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 939/1876] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:59.137672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:59.138339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:59.144829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:59.145527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:59.145977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:59.146684 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:59.147175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:59.147611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:59.287122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:55:59.295749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5a8a3823-c86b-4779-a988-9f60e2782ca7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.161978 Aug 31 19:55:59.296339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 938/1877] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:59 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:55:59.928515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:55:59.929118 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:55:59.936411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:59.936897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:59.937340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:55:59.938039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:55:59.938499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:55:59.938952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:00.154356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:00.161810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-24ff1c4c-5539-4a5f-a47f-a8783bcf6859 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.237173 Aug 31 19:56:00.162375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 940/1878] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:55:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:00.316925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:00.317542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:00.323994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:00.324480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:00.324918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:00.325618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:00.326095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:00.326510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:00.455621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:00.463797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bc6fbd8f-2cce-4be5-9594-114a3669aebc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150775 Aug 31 19:56:00.464889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 939/1879] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:00 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:01.183566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:01.184430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:01.187009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:01.191754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:01.192250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:01.192696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:01.193403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:01.193854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:01.194283 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:01.256177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:01.264601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e7094c30-7bbc-4f42-98f3-fef58d03c7ec tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085009 Aug 31 19:56:01.265163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 941/1880] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:01.486196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:01.486749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:01.493324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:01.493812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:01.494256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:01.494975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:01.495442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:01.496055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:01.500121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:01.623907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:01.632162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3f8e3496-a187-48a8-bdda-533fa3f14455 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149990 Aug 31 19:56:01.632730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 940/1881] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:01 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:02.286367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:02.287080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:02.294229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:02.294708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:02.295189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:02.295894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:02.296353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:02.296787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:02.357957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:02.366046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-413711f3-ce15-4639-9939-a2be101172b1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083553 Aug 31 19:56:02.366599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 942/1882] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:02.654772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:02.655550 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:02.662230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:02.663017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:02.663553 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:02.664578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:02.665039 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:02.665478 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:02.799411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:02.807572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3bfbf767-2c46-40b0-ac05-2b096712e0b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157420 Aug 31 19:56:02.808216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 941/1883] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:02 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:03.388419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:03.389066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:03.395500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:03.395984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:03.396427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:03.397389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:03.397569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:03.398003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:03.461825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:03.470101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e43a37e8-a1a7-4333-8e00-32f349de71c4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086294 Aug 31 19:56:03.470650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 943/1884] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:03.837693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:03.838349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:03.844954 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:03.845443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:03.845892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:03.846604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:03.847099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:03.847539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:03.983930 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:03.992517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0800b685-4916-48e9-9bab-c82ada5b2434 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158746 Aug 31 19:56:03.993313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 942/1885] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:03 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:04.491126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:04.491733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:04.498776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:04.499296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:04.499750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:04.500458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:04.500930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:04.501368 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:04.563722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:04.571879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5d83fa93-4ac1-4d7b-a8d8-e11e2dd6c2d0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084837 Aug 31 19:56:04.572443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 944/1886] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:05.014177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:05.014782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:05.022805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:05.023384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:05.023825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:05.024533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:05.024992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:05.025425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:05.157686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:05.166239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-baa5f98c-d454-4082-ac4a-c0e8bc81a2a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156292 Aug 31 19:56:05.166804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 943/1887] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:05 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:05.593372 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:05.607008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:05.607008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:05.607008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:05.607008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:05.607908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:05.607908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:05.607908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:05.665485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:05.673935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-84184897-db77-4c6b-bcd1-28daeb32ecb9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085169 Aug 31 19:56:05.674507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 945/1888] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:06.187681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:06.188300 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:06.194739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:06.195258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:06.195701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:06.196396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:06.196853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:06.197280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:06.330800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:06.340271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-3781a51d-781a-49fe-885a-c67938565d19 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156031 Aug 31 19:56:06.340844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 944/1889] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:06 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:06.696277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:06.696877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:06.703991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:06.704476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:06.704913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:06.705615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:06.706084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:06.706508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:06.770546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:06.779047 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-89d4e7e7-2b97-44be-9bd1-6956e4ef73ca tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086629 Aug 31 19:56:06.779639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 946/1890] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:07.361736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:07.362430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:07.368940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:07.369425 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:07.369866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:07.370563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:07.371159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:07.371589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:07.499383 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:07.508342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-faf60175-1cab-4e55-bda8-cd00313c4c49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150512 Aug 31 19:56:07.508913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 945/1891] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:07 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:07.800165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:07.800774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:07.807484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:07.808050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:07.808496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:07.809304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:07.809770 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:07.810464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:07.879882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:07.888990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a9afde99-15e9-40b4-8ba3-5cbaf8c7e58f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.092750 Aug 31 19:56:07.889560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 947/1892] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:08.535508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:08.536075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:08.543215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:08.543734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:08.544177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:08.544883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:08.545346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:08.545782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:08.681641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:08.690992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e47ba929-0da4-4cc9-b9fb-6d625b7b1a13 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159323 Aug 31 19:56:08.691572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 946/1893] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:08 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:08.910350 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:08.910983 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:08.917498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:08.917979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:08.918414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:08.919139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:08.919594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:08.920020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:08.981854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:08.990171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c80d2f5c-8178-4f8d-b33a-ef954b9022d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083592 Aug 31 19:56:08.990733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 948/1894] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:09.712928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:09.713573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:09.720522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:09.721002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:09.721439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:09.722133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:09.722585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:09.723105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:09.852555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:09.860872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6c45fb2a-6293-4e28-9fc7-0dc242375899 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151808 Aug 31 19:56:09.861450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 947/1895] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:09 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:10.013859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:10.014405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:10.020991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:10.021476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:10.021915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:10.022613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:10.023103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:10.023535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:10.084429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:10.093628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d5c6a4e0-eefc-46e1-a1ca-767344df285d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085192 Aug 31 19:56:10.094189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 949/1896] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:10.881728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:10.882330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:10.888906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:10.889404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:10.889846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:10.890552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:10.891057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:10.891472 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:11.020391 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:11.028903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-14076bec-81af-46e7-a2e9-9e07632cf50d tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151123 Aug 31 19:56:11.029481 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 948/1897] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:10 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:11.114729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:11.115377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:11.123241 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:11.123775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:11.124267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:11.125032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:11.125547 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:11.126034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:11.189453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:11.199805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-850b821e-d05a-4b44-a4b3-e181cc2cb994 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088986 Aug 31 19:56:11.200294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 950/1898] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:12.051352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:12.051985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:12.060104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:12.060412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:12.060633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:12.061357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:12.061820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:12.062256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:12.197523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:12.206464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-648258af-e231-4dd2-a2e2-137cafba50dd tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158963 Aug 31 19:56:12.207079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 949/1899] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:12 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:12.220743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:12.221375 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:12.227981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:12.228467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:12.228896 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:12.229726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:12.230134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:12.230564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:12.233230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:12.295847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:12.304767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2c1e51b9-75bb-4f92-b84f-5b19766515e3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087033 Aug 31 19:56:12.304767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 951/1900] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:13.229174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:13.229824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:13.236282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:13.236762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:13.237200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:13.237890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:13.238345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:13.238775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:13.326448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:13.327088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:13.333722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:13.334204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:13.334638 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:13.336286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:13.336286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:13.336286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:13.379446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:13.388373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f00f35a4-e452-4448-ba33-153b202bfd7f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.163676 Aug 31 19:56:13.389880 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 950/1901] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:13 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:13.403226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:13.411958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3e3432b8-06e5-4ad8-8dc5-33fe0120e975 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090314 Aug 31 19:56:13.412532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 952/1902] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:14.410293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:14.410937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:14.420497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:14.421357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:14.422142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:14.423417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:14.424269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:14.425081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:14.433645 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:14.434280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:14.442223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:14.442715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:14.443175 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:14.443891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:14.444340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:14.444782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:14.515957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:14.524255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-adec5039-39e8-4bad-a83d-e914041be6f1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.094315 Aug 31 19:56:14.524867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 953/1903] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:14.826597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:14.835056 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-24af3f3c-00a2-44d7-b248-4a61fa074626 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.428634 Aug 31 19:56:14.835626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 951/1904] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:14 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:15.545970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:15.546538 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:15.552979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:15.553468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:15.553913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:15.554619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:15.555113 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:15.555551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:15.628107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:15.637293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-596fdccd-f008-45fc-9b11-5c0ce5e239aa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.095632 Aug 31 19:56:15.637876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 954/1905] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:15.857206 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:15.857830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:15.864384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:15.865342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:15.865342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:15.866175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:15.866642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:15.867113 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:15.998093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:16.006278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-464b8abf-a44c-4fb2-a8d9-f9a737984ce9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153739 Aug 31 19:56:16.006844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 952/1906] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:15 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:16.658793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:16.659428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:16.665839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:16.666328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:16.666775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:16.668230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:16.668697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:16.669136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:16.739875 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:16.749784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a3ce0f4-edf3-4c9f-aea7-4a894a58980c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.094819 Aug 31 19:56:16.750356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 955/1907] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:17.028683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:17.029252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:17.035745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:17.036238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:17.036681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:17.037387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:17.037912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:17.038362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:17.167167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:17.175536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6d1857c5-7308-4e42-897e-6c0baeeffc60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152022 Aug 31 19:56:17.176109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 953/1908] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:17 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:17.771834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:17.772428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:17.780257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:17.780748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:17.781192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:17.781897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:17.782362 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:17.782795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:17.844324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:17.852761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-baaf7194-0c92-4b34-ba70-7660fbaf2ae5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084855 Aug 31 19:56:17.853333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 956/1909] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:18.197119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:18.197739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:18.205069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:18.205555 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:18.205995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:18.206691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:18.207181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:18.207619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:18.336360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:18.348238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9a639d43-ac56-472a-b9b5-d99c39390923 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154796 Aug 31 19:56:18.348812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 954/1910] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:18 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:18.874558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:18.875410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:18.881724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:18.882207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:18.882646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:18.883457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:18.883919 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:18.884349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:18.946464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:18.954998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2ab5b0ce-0adf-42ec-b68e-73cb0a88b340 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084963 Aug 31 19:56:18.955569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 957/1911] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:19.369765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:19.371414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:19.377996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:19.378485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:19.378953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:19.379657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:19.380115 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:19.380545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:19.524287 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:19.533162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f743082e-9baa-4dbd-87cb-7b62bd2f1319 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.167429 Aug 31 19:56:19.533739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 955/1912] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:19 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:19.977409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:19.978048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:19.984655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:19.985144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:19.985590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:19.986293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:19.986757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:19.987217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:20.050361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:20.058892 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-26f4712b-74df-4af4-9da1-716df55cc11e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085307 Aug 31 19:56:20.062990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 958/1913] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:20.555061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:20.555608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:20.562864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:20.563387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:20.563815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:20.564508 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:20.564961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:20.565384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:20.694241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:20.696493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:20.703134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1f299e92-21c0-4030-8fd9-d15605a0f328 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152025 Aug 31 19:56:20.703696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 956/1914] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:20 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:21.082369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:21.083057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:21.090391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:21.090894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:21.091348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:21.092048 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:21.092508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:21.092940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:21.158972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:21.168349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b4b4a8a9-c1ed-40fa-88a9-bd8a9729aa74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089744 Aug 31 19:56:21.172299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 959/1915] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:21.723951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:21.724602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:21.731644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:21.732133 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:21.732579 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:21.733278 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:21.733738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:21.734170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:21.868743 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:21.877403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-77d37b6b-a5a8-481b-addb-1f7cd89eefe4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157432 Aug 31 19:56:21.877966 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 957/1916] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:21 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:22.190448 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:22.191271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:22.197474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:22.197987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:22.198418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:22.199100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:22.199555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:22.199981 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:22.260654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:22.268706 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0d8a2882-609f-4abd-a7a9-889c8ed6c40a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082071 Aug 31 19:56:22.269276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 960/1917] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:22.898764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:22.899443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:22.907608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:22.908097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:22.908537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:22.909239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:22.909701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:22.910214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:23.048171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:23.056842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e166676d-f4c7-4b9f-9990-a2374a1e1b21 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.162295 Aug 31 19:56:23.057435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 958/1918] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:22 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:23.289762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:23.290426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:23.296866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:23.297344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:23.297778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:23.298471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:23.298955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:23.299382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:23.361063 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:23.369329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a6409533-0a29-411e-8e6a-318ff5858cff tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083597 Aug 31 19:56:23.370391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 961/1919] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:24.078618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:24.079269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:24.085935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:24.086433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:24.086892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:24.087644 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:24.088110 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:24.089129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:24.218939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:24.227275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-51ec51ae-389f-400d-b6c1-892bf248d975 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152556 Aug 31 19:56:24.227845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 959/1920] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:24 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:24.392837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:24.393411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:24.401789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:24.402042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:24.402537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:24.403289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:24.403746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:24.404173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:24.464855 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:24.473219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9068bd96-3432-4725-a064-e350c9815dfc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084330 Aug 31 19:56:24.473785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 962/1921] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:25.249827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:25.250485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:25.256928 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:25.257415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:25.257856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:25.258559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:25.259046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:25.259482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:25.397155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:25.406183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-13bb29fd-b339-4daa-a64c-ad72864c489f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.160268 Aug 31 19:56:25.406786 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 960/1922] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:25 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:25.494181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:25.495458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:25.501614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:25.502041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:25.502487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:25.503224 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:25.503723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:25.504158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:25.569755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:25.579017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-df571054-fae1-405a-a236-2fe35ee65c31 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088907 Aug 31 19:56:25.579581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 963/1923] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:26.427360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:26.428118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:26.434983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:26.435474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:26.435921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:26.436629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:26.437091 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:26.437526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:26.566038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:26.574294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-56ee5148-ffa9-4be4-a905-438a421674a8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150773 Aug 31 19:56:26.574855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 961/1924] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:26 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:26.599927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:26.600533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:26.608138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:26.608619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:26.609054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:26.609751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:26.610201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:26.610625 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:26.671421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:26.679449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-48069719-289d-4452-8e0e-38c98361c42c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083316 Aug 31 19:56:26.680012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 964/1925] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:27.595181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:27.595852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:27.602514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:27.603038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:27.603490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:27.604726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:27.605180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:27.605615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:27.701673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:27.702503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:27.709294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:27.709854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:27.710462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:27.711194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:27.711714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:27.712207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:27.741372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:27.750815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ddbfd033-6613-47be-a97f-c795424346f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159564 Aug 31 19:56:27.751429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 962/1926] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:27 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:27.777114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:27.785555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1c974e1c-127c-438c-a9bf-424742eef60d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088252 Aug 31 19:56:27.786058 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 965/1927] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:28.772913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:28.773518 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:28.775837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:28.781480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:28.781972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:28.782413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:28.783228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:28.783689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:28.784122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:28.806837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:28.807671 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:28.814727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:28.815255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:28.815696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:28.816406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:28.816867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:28.817334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:28.881760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:28.891346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-64b7610b-9657-472f-bd2c-0d0cad4f2e97 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088066 Aug 31 19:56:28.891993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 966/1928] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:28.915631 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:28.924078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-40dedd3c-263d-4811-bd0e-b5c8d3976a82 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155123 Aug 31 19:56:28.924647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 963/1929] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:28 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:29.912832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:29.913477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:29.920472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:29.920956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:29.921396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:29.922102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:29.922558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:29.923020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:29.945179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:29.945828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:29.952872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:29.953361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:29.954064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:29.954780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:29.955256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:29.955685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:29.997534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:29.999908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:30.007530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4505ccd2-b101-4f89-902a-a177642aed5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.098723 Aug 31 19:56:30.008951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 967/1930] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:30.112465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:30.122046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a3a10a1a-fdba-429c-9ff0-ee82519c21a9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.180682 Aug 31 19:56:30.122829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 964/1931] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:29 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:31.029591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:31.030194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:31.037169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:31.037657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:31.038169 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:31.038850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:31.039364 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:31.039749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:31.101339 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:31.110455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9b859bb8-5208-4c2b-a2be-fa3c14c9c107 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085304 Aug 31 19:56:31.111057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 968/1932] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:31.143716 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:31.144334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:31.150836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:31.151911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:31.152354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:31.153048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:31.153507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:31.153936 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:31.288693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:31.297225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-84827c44-cf65-484b-be4d-f53ae61d068c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157256 Aug 31 19:56:31.297863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 965/1933] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:31 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:32.132117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:32.132755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:32.135080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:32.140788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:32.146287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:32.146287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:32.146287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:32.146287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:32.146766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:32.207830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:32.217707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ec0400e4-d9dc-471e-bd66-bdf98a75ff2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089416 Aug 31 19:56:32.218286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 969/1934] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:32.319356 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:32.319969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:32.327539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:32.328051 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:32.328483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:32.329182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:32.329674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:32.330100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:32.465778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:32.474434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7a798bdf-5ac7-47c2-b3e8-895e4e45fd54 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159021 Aug 31 19:56:32.475037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 966/1935] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:32 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:33.246296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:33.246865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:33.253354 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:33.253840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:33.254285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:33.255037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:33.255502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:33.255935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:33.318294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:33.327165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-572dca56-ecd7-42e9-ac56-be87402463c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085399 Aug 31 19:56:33.327727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 970/1936] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:33.497134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:33.497720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:33.504797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:33.505288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:33.505737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:33.506509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:33.506951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:33.507384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:33.646282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:33.655600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-aa943e74-5f4e-45b2-a45e-073ab5e976b8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.163174 Aug 31 19:56:33.656210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 967/1937] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:33 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:34.348173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:34.348782 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:34.356201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:34.356690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:34.357161 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:34.357880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:34.358338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:34.358772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:34.424993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:34.433912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cc09c485-8242-47e3-9de0-1b0044a6f4a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089565 Aug 31 19:56:34.434738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 971/1938] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:34.677148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:34.677827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:34.684972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:34.685460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:34.685905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:34.686643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:34.687140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:34.687572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:34.821903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:34.830240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-377ace60-0184-4e8a-b110-77e5a1c5b051 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157056 Aug 31 19:56:34.830805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 968/1939] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:35.455188 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:35.455791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:35.462345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:35.462831 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:35.463309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:35.464316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:35.464785 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:35.465216 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:35.531837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:35.540697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dea759b2-82a1-41cc-93bb-ad1a3a4d1716 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089324 Aug 31 19:56:35.558099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 972/1940] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:35.851819 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:35.852420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:35.859913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:35.860407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:35.860844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:35.861552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:35.862046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:35.862484 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:35.997654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:36.005971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fb39da5d-0a21-4e79-b0ce-e46b55d33839 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158062 Aug 31 19:56:36.006531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 969/1941] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:36.566089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:36.566089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:36.568974 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:36.569449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:36.569879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:36.570564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:36.571054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:36.571479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:36.637095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:36.645210 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1a0b6a12-66ac-4cc3-a64e-2740f2b4e70d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087470 Aug 31 19:56:36.645780 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 973/1942] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:37.026516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:37.027297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:37.033634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:37.034148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:37.034591 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:37.035322 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:37.035781 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:37.036221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:37.169080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:37.177305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-056359f8-e00a-4bdd-ac9b-d668559f5d87 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154697 Aug 31 19:56:37.177869 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 970/1943] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:37 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:37.666950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:37.667512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:37.674624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:37.675155 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:37.675599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:37.676304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:37.676793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:37.677373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:37.738963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:37.747777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-89044080-7a65-4595-bd87-7ec2f1ec5ff0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084919 Aug 31 19:56:37.748385 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 974/1944] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:38.200667 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:38.201303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:38.208227 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:38.208761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:38.209228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:38.209952 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:38.210413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:38.210837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:38.341789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:38.350017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c61e6b71-6b41-426f-a82b-1a3b82429d2b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154061 Aug 31 19:56:38.350587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 971/1945] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:38.769014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:38.769628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:38.776089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:38.776566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:38.776999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:38.778069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:38.778335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:38.778758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:38.843966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:38.852434 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8c962746-f920-49b5-acfa-8d266a3dfc21 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087263 Aug 31 19:56:38.852999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 975/1946] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:39.372640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:39.373241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:39.380576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:39.381061 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:39.381557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:39.382337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:39.382798 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:39.383262 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:39.517523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:39.525537 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-92a6aba6-3a03-4200-ac8b-f409bad45c6a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157680 Aug 31 19:56:39.526038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 972/1947] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:39.874409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:39.875104 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:39.881665 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:39.882151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:39.882622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:39.883420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:39.883879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:39.884315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:39.946636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:39.955162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2a7bfec2-6e3c-4526-a7e6-22b6ba6c0dfe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084757 Aug 31 19:56:39.955739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 976/1948] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:40.546862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:40.547460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:40.554175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:40.554659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:40.555120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:40.555824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:40.556279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:40.556703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:40.572106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:40.690321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:40.698515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4e693b52-0b3a-43d1-ab80-04b7c3f7a9f3 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156762 Aug 31 19:56:40.699126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 973/1949] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:40.976650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:40.977263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:40.984233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:40.984726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:40.985166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:40.985870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:40.986330 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:40.986767 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:41.048830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:41.057014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8ac4e207-ca1f-4ae8-bc49-b40859ca9086 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084398 Aug 31 19:56:41.057586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 977/1950] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:41.720095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:41.720699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:41.727422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:41.727908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:41.728345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:41.729044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:41.729505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:41.729932 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:41.863012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:41.872171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c53c5d96-3187-4523-920d-7cd44d9c8952 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156061 Aug 31 19:56:41.873332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 974/1951] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:42.078258 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:42.078902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:42.085627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:42.086112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:42.086551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:42.087292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:42.087751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:42.088182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:42.150260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:42.159348 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5221da1f-968e-48f6-a465-d627cac55354 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084980 Aug 31 19:56:42.159911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 978/1952] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:42.895462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:42.896060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:42.902595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:42.903116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:42.903557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:42.904258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:42.904719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:42.905150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:43.038615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:43.048260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a6377e60-af20-43a1-9982-eff5ffe8be85 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156643 Aug 31 19:56:43.049225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 975/1953] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:43.181367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:43.181986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:43.188758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:43.189250 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:43.189728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:43.190433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:43.191177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:43.191654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:43.258284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:43.266511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c66f5fa8-4a54-4b0e-85f8-f80a452b9d64 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089076 Aug 31 19:56:43.267097 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 979/1954] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:44.070068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:44.070689 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:44.077703 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:44.078190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:44.078634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:44.079372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:44.079831 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:44.080260 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:44.208762 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:44.217104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5838f430-693a-47d0-ac8c-c3675954bad8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151583 Aug 31 19:56:44.217677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 976/1955] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:44 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:44.288298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:44.288911 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:44.295367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:44.295853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:44.296296 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:44.296999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:44.297460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:44.297891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:44.360497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:44.369433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-967d83b3-bf9c-46ba-8d14-fea4f8c17ff5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085500 Aug 31 19:56:44.370219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 980/1956] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:45.239509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:45.240792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:45.247251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:45.247742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:45.248180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:45.248882 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:45.249342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:45.249778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:45.382490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:45.390700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:45.391258 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-46021e22-458a-4043-8e00-0bb3c24651c5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155324 Aug 31 19:56:45.391379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:45.391495 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 977/1957] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:45.397800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:45.398322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:45.398763 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:45.399498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:45.399960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:45.400391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:45.463444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:45.471936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c4b0ad57-e2db-4ef3-9121-eead0dc221fb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085048 Aug 31 19:56:45.472516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 981/1958] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:46.412530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:46.413178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:46.420275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:46.420776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:46.421392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:46.422122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:46.423911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:46.423911 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:46.494106 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:46.494713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:46.501174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:46.501842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:46.502071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:46.502781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:46.503268 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:46.503701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:46.564562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:46.567762 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:46.574316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4ebb5bee-a6d7-42e1-8283-2bf2c5acb267 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.165606 Aug 31 19:56:46.578672 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 978/1959] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:46.578838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1843a560-b6df-4397-bd4e-c8b88df64ab3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088280 Aug 31 19:56:46.578838 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 982/1960] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:47.595996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:47.596673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:47.598620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:47.599322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:47.604087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:47.604580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:47.605025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:47.605735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:47.606196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:47.606454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:47.606625 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:47.606977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:47.607423 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:47.608134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:47.608607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:47.609028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:47.672784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:47.681537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-34174047-8e35-4a77-a61f-e8ba8c675c03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086732 Aug 31 19:56:47.682126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 983/1961] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:47.742276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:47.750617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d6bb6a4e-f692-40bb-9a21-aba14b2f510c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158605 Aug 31 19:56:47.751235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 979/1962] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:48.703485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:48.704120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:48.710662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:48.711222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:48.711663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:48.712370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:48.712827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:48.713251 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:48.728800 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:48.771829 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:48.772578 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:48.775374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:48.779529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:48.780024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:48.780471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:48.781193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:48.781657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:48.782090 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:48.783598 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bba32875-7c21-4e7f-b809-91e18b3a1b4d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084000 Aug 31 19:56:48.784177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 984/1963] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:48.916863 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:48.925104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8ba41303-5a21-4515-8c0a-f38edf332bba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157104 Aug 31 19:56:48.925682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 980/1964] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:48 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:56:49.807869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:49.808563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:49.815493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:49.815972 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:49.816411 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:49.817128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:49.817581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:49.818010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:49.883698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:49.892081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a202d3e5-bf33-4320-9938-01e09f1e5eb1 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089183 Aug 31 19:56:49.892655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 985/1965] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:49.946549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:49.947181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:49.953623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:49.954107 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:49.954545 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:49.955275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:49.955727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:49.956152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:50.091577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:50.099845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fd69e74f-ecce-42c1-b69a-938748822c96 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157307 Aug 31 19:56:50.100408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 981/1966] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:49 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:50.912677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:50.913283 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:50.919729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:50.920207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:50.920642 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:50.921329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:50.921784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:50.922202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:50.983383 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:50.991527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-89e05ca1-1033-460f-8b5b-3ca7293ec060 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082674 Aug 31 19:56:50.992087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 986/1967] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:51.121943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:51.122542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:51.129184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:51.129767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:51.130251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:51.130984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:51.131451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:51.131889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:51.262661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:51.271479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-add7b414-a139-47f2-bd35-06438d2088af tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153908 Aug 31 19:56:51.272151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 982/1968] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:51 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:52.013459 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:52.014092 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:52.020600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:52.021135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:52.021581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:52.022277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:52.022734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:52.023199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:52.089108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:52.097707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-09bd7445-651c-49fd-8b19-ce69c9369487 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088585 Aug 31 19:56:52.098277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 987/1969] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:52.293076 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:52.293705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:52.300313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:52.300810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:52.301257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:52.301964 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:52.302618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:52.303084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:52.433722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:52.442586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0bcbaa50-55f7-41ce-98bd-ee47a43d4410 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153543 Aug 31 19:56:52.443381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 983/1970] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:52 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:53.120303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:53.120923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:53.127628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:53.128108 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:53.128543 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:53.129232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:53.129685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:53.130111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:53.191256 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:53.199788 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7e0ee4a9-108d-46a4-a020-d7f5b1e9b3f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083959 Aug 31 19:56:53.200352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 988/1971] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:53.464460 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:53.465075 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:53.471497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:53.471980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:53.472416 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:53.473111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:53.473563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:53.473987 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:53.609919 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:53.618102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-35e13c10-8af3-4352-8d06-2688c54600a5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158311 Aug 31 19:56:53.618678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 984/1972] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:53 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:54.220966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:54.221562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:54.228349 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:54.228829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:54.229299 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:54.229992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:54.230443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:54.230884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:54.293965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:54.302300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-036562c8-7c5f-4cd8-a862-fbb66a63fe68 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085234 Aug 31 19:56:54.302854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 989/1973] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:54.639052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:54.639991 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:54.647293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:54.647771 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:54.648204 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:54.649026 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:54.649488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:54.649921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:54.779433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:54.787738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-27b85bc4-b53d-4795-b73d-ad72879ffc77 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152671 Aug 31 19:56:54.791174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 985/1974] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:54 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:55.325217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:55.326049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:55.337013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:55.337508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:55.337947 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:55.338653 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:55.339137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:55.339678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:55.416995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:55.426317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-02c7ce86-3901-490e-b29b-9c6719017874 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.106325 Aug 31 19:56:55.426922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 990/1975] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:55.810101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:55.810768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:55.818603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:55.819122 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:55.819878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:55.820901 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:55.821731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:55.822507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:55.961465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:55.970717 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d1d43c46-fdb3-4dc6-b1e3-2e9b4bb49126 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.164869 Aug 31 19:56:55.971314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 986/1976] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:55 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:56.449825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:56.450487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:56.456925 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:56.457408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:56.457846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:56.458546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:56.459053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:56.459487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:56.522835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:56.531435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6c67903a-f83f-469f-8f7b-8c5d5766966f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086052 Aug 31 19:56:56.532007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 991/1977] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:56.991621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:56.992273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:56.998485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:56.999014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:56.999465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:57.000166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:57.000637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:57.001079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:57.130226 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:57.139634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a3425dd0-e2bd-408b-985a-070baba4d2ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151886 Aug 31 19:56:57.140205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 987/1978] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:56 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:57.552050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:57.552615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:57.560231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:57.560711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:57.561183 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:57.561917 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:57.562369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:57.562799 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:57.626628 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:57.634946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-65df67cc-9eb8-46fb-a1fa-4d5f2dc4815d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086871 Aug 31 19:56:57.635511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 992/1979] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:58.161778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:58.162379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:58.169125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:58.169616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:58.170070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:58.170779 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:58.171269 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:58.171704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:58.305469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:58.315055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8cd02e12-bde0-498a-80f4-3cd25290d762 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157129 Aug 31 19:56:58.315634 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 988/1980] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:58 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:58.656851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:58.657587 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:58.664156 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:58.664641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:58.665080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:58.665944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:58.666414 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:58.666923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:58.730433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:58.738677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5eac05a8-24a0-4d43-b383-016d80b87919 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086717 Aug 31 19:56:58.739260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 993/1981] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:59.336618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:59.337242 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:59.340313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:56:59.345139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:59.352413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:59.352413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:59.352413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:59.352413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:59.352876 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:59.484140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:59.492700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-55977420-ba5a-4624-8972-54798ab42d61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159961 Aug 31 19:56:59.493277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 989/1982] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:59 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:56:59.760624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:56:59.761836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:56:59.769078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:59.769570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:59.770014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:59.770723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:56:59.771215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:56:59.771734 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:56:59.835450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:56:59.844778 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-192cc8bb-f814-4b25-996d-fac5d031157a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088348 Aug 31 19:56:59.845369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 994/1983] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:56:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:00.514121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:00.514700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:00.521418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:00.521903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:00.522338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:00.523117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:00.523572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:00.524000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:00.526570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:00.653633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:00.661978 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e40bd7e9-7a66-4a4d-a9de-1ea3200b1c26 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151914 Aug 31 19:57:00.662558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 990/1984] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:00 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:00.867116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:00.867717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:00.874733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:00.875327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:00.875827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:00.876636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:00.877197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:00.877753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:00.944987 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:00.954154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ab195bdf-4fc7-4a52-9b8b-f6af298b0325 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.091214 Aug 31 19:57:00.954772 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 995/1985] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:01.683321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:01.683939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:01.690576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:01.691118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:01.691562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:01.692268 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:01.692726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:01.693155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:01.828783 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:01.837002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a307e12b-28d0-41e9-8c6a-f7122a592bf7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157865 Aug 31 19:57:01.837568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 991/1986] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:01 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:01.976111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:01.976689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:01.983425 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:01.983928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:01.984408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:01.985120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:01.985583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:01.986034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:02.047794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:02.056031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1d1e6ccb-f2b8-4eeb-8564-9076288551fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083973 Aug 31 19:57:02.056604 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 996/1987] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:02.859294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:02.859921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:02.866594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:02.867129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:02.867574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:02.868289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:02.868753 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:02.869184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:03.002845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:03.011112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-afadca2c-0821-45bb-b445-e71ed1870a24 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155941 Aug 31 19:57:03.012489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 992/1988] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:02 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:03.078400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:03.079041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:03.081304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:03.086050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:03.086536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:03.087015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:03.087716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:03.088174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:03.088603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:03.150470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:03.158673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-baebe11a-13d1-48fb-9c6e-edd2e0df00f3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084858 Aug 31 19:57:03.159266 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 997/1989] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:04.032324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:04.033024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:04.039551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:04.040044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:04.040486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:04.041200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:04.041669 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:04.042103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:04.175835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:04.179814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:04.180436 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:04.185261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-28a970f0-1f5a-400e-8f0f-d0803bee7570 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156533 Aug 31 19:57:04.185846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 993/1990] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:04 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:04.187817 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:04.188306 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:04.188749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:04.189467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:04.189933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:04.190366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:04.256177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:04.265168 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-91b3bbc4-972a-497b-a667-f5f9b8e0e18d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089202 Aug 31 19:57:04.265735 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 998/1991] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:05.206273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:05.206956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:05.213548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:05.214035 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:05.214513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:05.215744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:05.216345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:05.216785 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:05.286844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:05.287656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:05.295015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:05.295503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:05.295934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:05.296636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:05.297083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:05.297504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:05.352699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:05.363464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-047f34f1-c249-4262-aadd-8633a2e869ed tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.161014 Aug 31 19:57:05.364245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 994/1992] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:05 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:05.367064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:05.375712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a69a26e0-13b9-4723-99f7-3f1ac07c8f39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.092681 Aug 31 19:57:05.376317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 999/1993] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:06.385832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:06.386434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:06.393059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:06.393551 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:06.394001 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:06.394713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:06.395225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:06.395666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:06.396500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:06.397115 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:06.403595 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:06.404081 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:06.404515 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:06.405218 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:06.405674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:06.406102 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:06.470903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:06.479600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-427139b6-921e-4f44-b102-27f871a61fee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086950 Aug 31 19:57:06.480181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1000/1994] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:06.528686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:06.538190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c874350b-2a1c-49de-b669-a2810286c592 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156338 Aug 31 19:57:06.538761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 995/1995] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:06 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:07.500741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:07.501353 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:07.507791 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:07.508271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:07.508708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:07.509408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:07.509863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:07.510292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:07.514317 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:07.559826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:07.560509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:07.568470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:07.569098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:07.569536 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:07.570236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:07.570691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:07.571145 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:07.573932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:07.582562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5b8842f0-3aff-43b2-ba0a-c21c8dcc684a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085724 Aug 31 19:57:07.583160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1001/1996] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:07.710947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:07.720393 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e7dfa6e3-7838-4390-acfa-447c263cae29 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.164800 Aug 31 19:57:07.720960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 996/1997] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:07 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:08.603843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:08.604478 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:08.611633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:08.612126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:08.612564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:08.613259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:08.613713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:08.614140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:08.675813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:08.684284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0779047d-0f46-47d9-9d72-2fe2b892d872 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084067 Aug 31 19:57:08.684852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1002/1998] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:08.741947 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:08.742557 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:08.749979 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:08.750466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:08.750970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:08.751688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:08.752146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:08.752574 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:08.882265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:08.891291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-78da3f7f-2aa3-4269-8792-285dd6a7f228 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153210 Aug 31 19:57:08.891861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 997/1999] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:08 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:09.706002 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:09.706608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:09.713327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:09.713813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:09.714255 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:09.714997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:09.715461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:09.715891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:09.781576 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:09.789806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a349bf27-2077-439c-a21c-00ec8d1e950b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088729 Aug 31 19:57:09.790374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1003/2000] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:09.912476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:09.913130 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:09.919664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:09.920152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:09.920599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:09.921304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:09.921774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:09.922207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:10.059443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:10.069139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8e6a06fc-49ea-4a32-902a-0120578e638a tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.160528 Aug 31 19:57:10.069712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 998/2001] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:09 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:10.811476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:10.812087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:10.819023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:10.819511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:10.820044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:10.820752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:10.821215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:10.821647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:10.883152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:10.892020 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eda108bf-fbbb-4423-a273-91d9e8002a74 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084776 Aug 31 19:57:10.892601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1004/2002] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:11.090714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:11.091373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:11.098525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:11.099052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:11.099492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:11.100201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:11.100656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:11.101084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:11.232637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:11.241167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-731a65b6-3ce3-4884-9b31-99dea928152e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154319 Aug 31 19:57:11.241745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 999/2003] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:11 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:11.913140 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:11.913746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:11.920282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:11.920754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:11.921185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:11.922492 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:11.922971 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:11.923394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:11.989149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:11.997240 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f687db88-50bb-44ef-b271-8c23bb13ba06 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087964 Aug 31 19:57:11.997814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1005/2004] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:12.263348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:12.263956 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:12.270981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:12.271524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:12.271970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:12.272679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:12.273146 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:12.273594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:12.403885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:12.413857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ef8fc84f-e89a-41eb-a5df-2e831d8194f9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154464 Aug 31 19:57:12.414446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1000/2005] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:12 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:13.020955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:13.021567 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:13.028166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:13.028658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:13.029101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:13.029806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:13.030267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:13.030698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:13.092211 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:13.100765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a0a04367-6833-4e6d-bae7-289d5ca9e43f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083804 Aug 31 19:57:13.101318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1006/2006] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:13.434830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:13.435483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:13.442955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:13.443457 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:13.443935 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:13.444650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:13.445116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:13.445552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:13.582161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:13.590503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2296e63a-e4e1-45cd-8a6e-3c051f3a1a93 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159920 Aug 31 19:57:13.591109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1001/2007] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:13 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:14.122556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:14.123186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:14.130259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:14.130743 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:14.131200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:14.131888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:14.132342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:14.132760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:14.196244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:14.205454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-de82e625-90a2-4edd-ac7d-dee25bb8bac4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086743 Aug 31 19:57:14.206033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1007/2008] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:14.612296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:14.612894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:14.619381 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:14.619867 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:14.620311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:14.621013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:14.621474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:14.621904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:14.753085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:14.761394 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-71fecfb8-88da-43cd-9b76-b56d9b0e383f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153138 Aug 31 19:57:14.761951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1002/2009] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:14 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:15.227073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:15.227685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:15.234062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:15.234860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:15.235331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:15.236039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:15.236498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:15.236927 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:15.304733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:15.314267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d5752784-020f-48b9-acea-5af8d00b06eb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.091156 Aug 31 19:57:15.314839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1008/2010] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:15.783112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:15.783735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:15.790443 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:15.790974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:15.791485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:15.792196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:15.792678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:15.793097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:15.929784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:15.938301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2d111246-09ad-4eaa-a7bc-5bce8e5a1f12 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159643 Aug 31 19:57:15.938883 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1003/2011] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:15 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:16.335380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:16.335978 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:16.342600 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:16.343125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:16.344233 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:16.344935 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:16.345389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:16.345815 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:16.409654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:16.417870 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-927d9623-fe64-4859-9f28-1dcb4c4b4d93 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086486 Aug 31 19:57:16.418440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1009/2012] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:16.959270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:16.959906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:16.966384 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:16.966892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:16.967346 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:16.968054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:16.968517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:16.968958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:17.104124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:17.112254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-deffdfdd-718c-4ff6-806f-ce3a4353ed5c tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157033 Aug 31 19:57:17.112815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1004/2013] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:16 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:17.439541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:17.440185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:17.446430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:17.446939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:17.447387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:17.448096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:17.448558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:17.448992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:17.512565 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:17.522059 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bce772ec-67d4-4775-8904-729f49bc0680 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086987 Aug 31 19:57:17.522644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1010/2014] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:18.133875 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:18.134532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:18.143997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:18.144485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:18.144945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:18.145800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:18.146125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:18.147530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:18.288804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:18.297843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1aa77383-02fa-47aa-983c-b4f12fd801a2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.167987 Aug 31 19:57:18.298409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1005/2015] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:18 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:18.543085 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:18.543664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:18.551008 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:18.551420 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:18.551862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:18.552564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:18.553018 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:18.553449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:18.617777 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:18.626648 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-60909055-2023-464b-aef4-57fb4e6f730a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087514 Aug 31 19:57:18.627271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1011/2016] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:19.319388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:19.319995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:19.326408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:19.326903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:19.327353 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:19.328593 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:19.329050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:19.329474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:19.468433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:19.470784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:19.477509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e68e3c91-e015-44fc-a562-76e1c507aded tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.162007 Aug 31 19:57:19.478131 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1006/2017] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:19 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:19.648148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:19.648753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:19.655144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:19.655653 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:19.656086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:19.656794 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:19.657249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:19.657673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:19.722125 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:19.730546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-35602ecf-1300-4d9c-b395-83c34f11abee tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086267 Aug 31 19:57:19.731150 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1012/2018] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:20.499045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:20.499648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:20.506658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:20.507173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:20.507619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:20.508332 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:20.508796 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:20.509231 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:20.642697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:20.650897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b4234769-c033-4731-92fd-280bf3b58c1e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155732 Aug 31 19:57:20.651466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1007/2019] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:20 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:20.752389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:20.753038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:20.759508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:20.759995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:20.760438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:20.761141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:20.761601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:20.762074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:20.823347 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:20.831930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c681a9de-da85-49ba-81e0-0d42c0d25522 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083968 Aug 31 19:57:20.832560 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1013/2020] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:21.673688 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:21.674311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:21.680748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:21.681222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:21.681655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:21.682373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:21.682825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:21.683271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:21.816270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:21.824833 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-872c66b9-9df8-43a0-bd69-190dfbd35780 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155729 Aug 31 19:57:21.825400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1008/2021] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:21 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:21.853525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:21.854148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:21.861568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:21.862057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:21.862508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:21.863259 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:21.863724 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:21.864159 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:21.929185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:21.934457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0961ca65-cfe1-416b-8d7c-a2a0e6ed5972 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084491 Aug 31 19:57:21.935056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1014/2022] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:22.846314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:22.846963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:22.853842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:22.854375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:22.854848 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:22.855622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:22.856089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:22.856538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:22.956406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:22.957129 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:22.963961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:22.964454 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:22.964895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:22.965615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:22.966076 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:22.966505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:22.991405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:22.999710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ebeb9f71-18b3-4696-8a3b-065f3278f895 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157609 Aug 31 19:57:23.000303 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1009/2023] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:22 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:23.035934 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:23.044243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f6e8a81e-ffdd-49fc-9ab1-afbb556ead58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.091907 Aug 31 19:57:23.044812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1015/2024] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:24.021546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:24.022232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:24.028570 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:24.029055 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:24.029492 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:24.030187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:24.030642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:24.031111 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:24.066314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:24.066959 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:24.073951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:24.074435 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:24.074902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:24.075622 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:24.076075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:24.076495 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:24.140686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:24.149174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b4d36974-5b54-464b-a2ee-ad20ca720d23 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086716 Aug 31 19:57:24.149753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1016/2025] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:24 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:24.229873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:24.238499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-20728c73-c6d0-4652-8efc-ce85a4a74eb2 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.220914 Aug 31 19:57:24.239103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1010/2026] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:24 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:25.170789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:25.171445 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:25.179532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:25.180089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:25.180531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:25.181307 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:25.181704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:25.182137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:25.259922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:25.260542 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:25.268411 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:25.269044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:25.269496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:25.270222 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:25.270686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:25.271152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:25.293207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:25.295453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:25.302997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-268905f5-09e4-44d9-9d1a-54f8dc309c2e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.136092 Aug 31 19:57:25.303589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1017/2027] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:25.407205 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:25.416121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-81ae2725-632b-4bda-b80a-3df5d27a2a60 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.160081 Aug 31 19:57:25.416698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1011/2028] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:25 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:26.325196 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:26.325801 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:26.332338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:26.333500 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:26.333850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:26.334580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:26.335062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:26.335491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:26.399725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:26.409931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-38f8339b-8f68-4c82-a934-3e94a7497a2d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088930 Aug 31 19:57:26.410514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1018/2029] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:26.437845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:26.438471 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:26.445719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:26.446199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:26.446635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:26.447451 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:26.447917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:26.448343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:26.577347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:26.586211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-32d6df3f-d75b-45d8-bec4-ae51646180a0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152541 Aug 31 19:57:26.586789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1012/2030] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:26 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:27.430688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:27.431400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:27.438012 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:27.438498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:27.439765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:27.439765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:27.440119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:27.440498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:27.508003 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:27.516664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3195af32-3660-4c21-ab6c-d0a241b8dabb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089880 Aug 31 19:57:27.517247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1019/2031] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:27.607768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:27.608412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:27.615547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:27.616160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:27.616748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:27.617455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:27.617912 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:27.618341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:27.749526 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:27.758576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-80b0a924-77a7-4a0f-be8a-9455a30fab14 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154706 Aug 31 19:57:27.759186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1013/2032] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:27 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:28.538380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:28.538980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:28.545300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:28.545776 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:28.546207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:28.546926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:28.547384 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:28.547802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:28.609949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:28.619074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5ba9ce34-d869-424a-9110-eba3ce898118 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085248 Aug 31 19:57:28.619637 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1020/2033] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:28.780388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:28.781046 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:28.788458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:28.788893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:28.789340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:28.790050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:28.790514 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:28.790992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:28.920479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:28.929044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c7d27996-fa97-4518-89e8-5513aef4edaf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152416 Aug 31 19:57:28.929622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1014/2034] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:28 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:29.639902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:29.640518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:29.647357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:29.647863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:29.648295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:29.648993 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:29.649491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:29.649918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:29.711685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:29.719969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9fe8294b-310b-4111-a6dc-2bdfae905ef8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084067 Aug 31 19:57:29.720540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1021/2035] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:29.950082 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:29.950682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:29.953073 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:29.957793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:29.958279 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:29.958720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:29.959450 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:29.959908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:29.960352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:30.095808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:30.105097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-affe9a98-bc5c-4d02-bec0-5dbc358a706b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158987 Aug 31 19:57:30.105675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1015/2036] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:29 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:30.741376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:30.741992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:30.748562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:30.749052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:30.749491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:30.750193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:30.750654 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:30.751123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:30.813236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:30.822377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d65e8bf2-26e8-4082-9e47-0f14f313eb0e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084893 Aug 31 19:57:30.822966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1022/2037] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:31.126633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:31.127402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:31.134527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:31.135043 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:31.135485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:31.136182 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:31.136641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:31.137071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:31.265856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:31.274454 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5550d53c-823b-459b-bb4b-32aa500340f1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151459 Aug 31 19:57:31.275057 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1016/2038] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:31 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:31.843468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:31.844068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:31.850529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:31.851039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:31.852148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:31.852877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:31.853418 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:31.853843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:31.917528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:31.925722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-25c6ad0b-4b19-4b3f-8d5f-aa97a8be3f33 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086160 Aug 31 19:57:31.926293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1023/2039] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:32.295970 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:32.296585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:32.303103 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:32.303587 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:32.304019 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:32.305408 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:32.305884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:32.306464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:32.439174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:32.447941 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e3d60324-eb80-4b70-900c-844972a6d8f0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155846 Aug 31 19:57:32.448513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1017/2040] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:32 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:32.949122 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:32.949755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:32.956269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:32.956746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:32.957179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:32.957873 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:32.958323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:32.958746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:33.019329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:33.028005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6cc41f87-e59c-4918-8e97-cfb35d37826d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084880 Aug 31 19:57:33.028570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1024/2041] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:33.469513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:33.470140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:33.476763 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:33.477254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:33.477700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:33.478409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:33.478896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:33.479338 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:33.612139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:33.620843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6429c7fa-1181-4d96-9a81-98e8ffb2e5ec tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155189 Aug 31 19:57:33.621433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1018/2042] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:33 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:34.050416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:34.051143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:34.053548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=56 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:34.059220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:34.059711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:34.060153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:34.060860 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:34.061323 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:34.061922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:34.135223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:34.143546 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-df19f9d3-8ea1-4794-b632-946bef7bc003 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.097427 Aug 31 19:57:34.144120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1025/2043] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:34 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:34.641697 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:34.642314 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:34.649427 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:34.649916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:34.650355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:34.651102 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:34.651563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:34.651998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:34.783028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:34.788044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-13f26faa-62db-4b15-9ded-63d12b7973b6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150249 Aug 31 19:57:34.788609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1019/2044] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:34 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:35.164452 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:35.165071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:35.171632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:35.172114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:35.172557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:35.173257 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:35.173717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:35.174222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:35.235992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:35.244300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8e07f85d-28d4-4f36-b806-d0743fdfedbc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083738 Aug 31 19:57:35.244857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1026/2045] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:35.810220 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:35.810845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:35.817585 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:35.818087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:35.818533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:35.819264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:35.819730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:35.820898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:35.954077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:35.963212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1658fc22-915c-4c7a-a3f0-8ed8d90583e5 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157363 Aug 31 19:57:35.963782 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1020/2046] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:35 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:36.265664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:36.266271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:36.272868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:36.273357 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:36.273803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:36.274601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:36.275089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:36.275519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:36.339962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:36.348171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-92b11092-d823-4ae4-b82a-02e315cce598 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086384 Aug 31 19:57:36.348736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1027/2047] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:36.984830 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:36.985455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:36.992099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:36.992589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:36.993032 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:36.993733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:36.994194 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:36.994626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:37.121682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:37.130158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b6e53e08-1706-4a84-9739-bf450e59837f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149373 Aug 31 19:57:37.130742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1021/2048] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:36 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:37.369727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:37.370316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:37.376839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:37.377388 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:37.377825 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:37.378521 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:37.379004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:37.379429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:37.441431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:37.449679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0509030a-04ca-46e4-bb7c-0af1430c10ef tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084389 Aug 31 19:57:37.450243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1028/2049] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:38.153079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:38.153696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:38.160195 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:38.160659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:38.161099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:38.161797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:38.162255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:38.162687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:38.294726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:38.302977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-bf7b3290-55fe-4f0e-9174-cf55fa129d10 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154433 Aug 31 19:57:38.303543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1022/2050] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:38 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:38.470957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:38.471506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:38.478186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:38.478664 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:38.479146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:38.479844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:38.480301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:38.480727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:38.541236 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:38.549504 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-89262950-4fb2-4712-b9a8-25b9d9dc7283 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082468 Aug 31 19:57:38.550070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1029/2051] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:39.325065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:39.325681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:39.332148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:39.332624 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:39.333064 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:39.333761 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:39.334219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:39.334650 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:39.349809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:39.467720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:39.476345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a2d729fb-9575-445a-bd72-0b06cc0497bf tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155140 Aug 31 19:57:39.477161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1023/2052] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:39 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:39.572185 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:39.572803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:39.579342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:39.579830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:39.580271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:39.581135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:39.581599 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:39.582031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:39.643476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:39.652529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e669b83d-9068-4d87-805d-2fdee72a2bbe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085142 Aug 31 19:57:39.653101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1030/2053] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:40.497120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:40.497691 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:40.504439 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:40.504920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:40.505358 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:40.506058 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:40.506515 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:40.506969 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:40.635862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:40.644105 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-371d8711-1326-4407-98be-bde638f16372 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150953 Aug 31 19:57:40.644661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1024/2054] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:40 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:40.673472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:40.674082 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:40.681594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:40.682086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:40.682516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:40.683243 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:40.683954 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:40.684382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:40.750750 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:40.759850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-36753ce4-702d-45e1-bb59-90096d184ea3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090297 Aug 31 19:57:40.760430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1031/2055] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:41.666614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:41.667257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:41.673643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:41.674128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:41.674568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:41.675293 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:41.675754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:41.676186 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:41.780271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:41.781060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:41.787835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:41.788318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:41.788796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:41.789846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:41.790341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:41.790804 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:41.810159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:41.818516 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c5b8c69a-69f4-40d2-9c85-51d793bf31f4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.156504 Aug 31 19:57:41.819128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1025/2056] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:41 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:41.854176 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:41.862722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2790d24d-a6bf-45da-a6b4-d5a8c04375ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086311 Aug 31 19:57:41.863395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1032/2057] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:42.840897 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:42.841525 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:42.848067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:42.848559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:42.849006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:42.849708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:42.850173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:42.850608 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:42.884062 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:42.884757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:42.891361 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:42.891952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:42.892392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:42.893215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:42.893696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:42.894417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:42.956395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:42.968651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a8ee979f-e405-4362-8adb-208df30aba4e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088119 Aug 31 19:57:42.969541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1033/2058] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:42.981997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:42.990191 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-468134b8-faed-4523-8873-56b82a8973ba tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153198 Aug 31 19:57:42.990756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1026/2059] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:42 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:43.991153 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:43.992710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:43.999174 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:43.999662 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:44.000105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:44.000811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:44.001271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:44.001704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:44.011167 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:44.011788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:44.017004 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:44.018104 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:44.018597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:44.019071 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:44.019775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:44.020234 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:44.020664 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:44.068103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:44.076661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-271085e9-1a52-49f6-8773-bc4926ca1913 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089417 Aug 31 19:57:44.077884 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1034/2060] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:44.155908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:44.164710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-16cb0d06-59ad-4871-b227-ea2f37163d06 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157461 Aug 31 19:57:44.165333 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1027/2061] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:44 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:45.099322 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:45.099928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:45.106407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:45.106918 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:45.107356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:45.108043 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:45.108497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:45.108920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:45.172445 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:45.181341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ac5dbe22-6b8b-413e-93f7-c04e606cf606 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085857 Aug 31 19:57:45.181914 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1035/2062] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:45 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:45.186641 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:45.187308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:45.194078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:45.194609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:45.195846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:45.196651 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:45.197117 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:45.197546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:45.324780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:45.333059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-eac53f57-c061-4833-bee2-cbe4dc5845b7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150695 Aug 31 19:57:45.333627 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1028/2063] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:45 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:57:46.202220 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:46.202826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:46.209310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:46.209790 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:46.211146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:46.212184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:46.212632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:46.213054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:46.273976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:46.282194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0a5a86dd-4dbd-4d5c-8f8b-044a4c855e15 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083784 Aug 31 19:57:46.282756 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1036/2064] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:46.355149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:46.355750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:46.362372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:46.362852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:46.363319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:46.364008 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:46.364466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:46.364889 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:46.495432 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:46.504203 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e4044126-9de0-4f86-a2bb-35d346881549 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153577 Aug 31 19:57:46.504835 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1029/2065] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:46 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:47.303184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:47.303787 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:47.311117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:47.311597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:47.312032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:47.312802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:47.313170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:47.313588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:47.376998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:47.386288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d8d7fe68-4bc3-4355-ab0a-939ab12342ed tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087038 Aug 31 19:57:47.386859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1037/2066] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:47.525217 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:47.525892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:47.532465 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:47.532962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:47.533407 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:47.534166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:47.534729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:47.535197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:47.666048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:47.674285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-42c5b26a-f8d5-42c7-9ad4-142eb5fb9cc7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152953 Aug 31 19:57:47.674857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1030/2067] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:47 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:48.407865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:48.408613 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:48.415811 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:48.416301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:48.416738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:48.417444 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:48.417905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:48.418337 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:48.479158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:48.487338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9d469da9-635d-4283-a548-97ebc117d4af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083492 Aug 31 19:57:48.487902 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1038/2068] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:48.695535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:48.696196 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:48.702566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:48.703089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:48.703527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:48.704215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:48.704673 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:48.705095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:48.831652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:48.840512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d0d6bd83-ce80-4819-aa32-7c003f0ab7dc tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148779 Aug 31 19:57:48.841088 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1031/2069] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:48 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:49.509369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:49.510026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:49.517505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:49.517985 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:49.518443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:49.519182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:49.519634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:49.520100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:49.586468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:49.595112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4ab67ade-ce0d-47ea-b3c5-eb9821468af4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089624 Aug 31 19:57:49.595689 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1039/2070] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:49.862125 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:49.862713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:49.869174 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:49.869662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:49.870106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:49.870808 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:49.876571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:49.876571 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:50.006895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:50.013731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-85b19701-22d7-438b-a413-47c965b02929 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155589 Aug 31 19:57:50.014309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1032/2071] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:49 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:50.616952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:50.618054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:50.624619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:50.625103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:50.625541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:50.626235 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:50.626691 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:50.627145 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:50.889877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:50.898142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f8f52c81-ab6c-4c07-9bcb-2ec014734c6c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.285091 Aug 31 19:57:50.898715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1040/2072] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:51.035259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:51.035866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:51.042995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:51.043475 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:51.043908 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:51.044595 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:51.045047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:51.045472 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:51.174847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:51.183429 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-52a07643-7db8-4403-9355-ad7df580a82b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151683 Aug 31 19:57:51.184016 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1033/2073] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:51 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:51.919373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:51.919975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:51.926557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:51.927072 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:51.927507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:51.928192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:51.928643 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:51.929064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:51.989037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:51.997748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-43d7f24e-3512-42ea-aa0e-378776bf2b66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082244 Aug 31 19:57:51.998298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1041/2074] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:52.204430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:52.204988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:52.211719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:52.212208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:52.212652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:52.213357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:52.213826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:52.214261 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:52.345823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:52.354572 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-237acbd2-f96e-4c6a-8671-e5b0ed624ce6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154278 Aug 31 19:57:52.355175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1034/2075] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:52 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:53.019537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:53.020151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:53.027430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:53.027922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:53.028369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:53.029071 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:53.029531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:53.029963 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:53.090822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:53.099779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8198f5d0-4f15-4684-99a7-0b09a4810ab0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084102 Aug 31 19:57:53.100345 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1042/2076] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:53.375679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:53.376362 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:53.382773 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:53.383992 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:53.384470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:53.385173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:53.385647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:53.386139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:53.512706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:53.521013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-93bcbf8e-b029-4b6b-af6c-02a73599d764 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149213 Aug 31 19:57:53.521580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1035/2077] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:53 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:54.122260 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:54.122900 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:54.129365 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:54.129853 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:54.130295 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:54.131031 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:54.131497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:54.131931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:54.192542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:54.201518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5df2c2ed-5fb4-4fb2-8f9e-56fa5a67a246 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083085 Aug 31 19:57:54.202093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1043/2078] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:54.542566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:54.543188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:54.549527 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:54.550006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:54.550444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:54.551162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:54.551618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:54.552042 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:54.680412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:54.689638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-62cbfb9a-d6a7-4739-81c3-08d77c21efc8 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151747 Aug 31 19:57:54.690372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1036/2079] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:54 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:55.223633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:55.224269 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:55.231847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:55.232327 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:55.232764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:55.235069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:55.235069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:55.235069 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:55.307166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:55.317165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-18981a11-8efe-4a1d-8fc6-c36b7c9ae463 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.097988 Aug 31 19:57:55.317739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1044/2080] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:55 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:55.711750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:55.715126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:55.719903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:55.720744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:55.721458 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:55.722615 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:55.723430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:55.724151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:55.865422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:55.873744 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6677b62e-9976-4a42-85c4-c978db8192d1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.166449 Aug 31 19:57:55.874316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1037/2081] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:55 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:56.339510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:56.340126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:56.346594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:56.347120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:56.347569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:56.348271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:56.348732 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:56.349163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:56.409396 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:56.417818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ac01ea21-b039-4c7f-a14c-4b871bfd0109 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082253 Aug 31 19:57:56.418391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1045/2082] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:56.896479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:56.897390 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:56.903522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:56.904010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:56.904453 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:56.905149 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:56.905606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:56.906035 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:57.033513 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:57.043006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-58fa9d96-ee29-4bfa-ac7a-f9d317380416 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150549 Aug 31 19:57:57.043580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1038/2083] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:56 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:57.439693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:57.440335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:57.447329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:57.457627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:57.457627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:57.457627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:57.457627 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:57.459021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:57.511289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:57.519555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-420fa953-5da9-47dc-a163-2aadb5002ce9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083783 Aug 31 19:57:57.520126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1046/2084] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:58.064412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:58.065012 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:58.072257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:58.072741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:58.073179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:58.073870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:58.074323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:58.074747 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:58.204653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:58.212800 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-20008ce5-de10-4cbb-ac0a-0c6f16b88001 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152369 Aug 31 19:57:58.213361 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1039/2085] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:58 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:58.541857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:58.542502 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:58.549124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:58.549612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:58.550052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:58.550753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:58.551247 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:58.551684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:58.612758 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:58.621128 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-624a1e84-9050-4b5a-9aa8-2a5c9e7cbd4f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083781 Aug 31 19:57:58.621704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1047/2086] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:59.233637 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:59.234267 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:59.240748 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:59.241236 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:59.241681 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:59.242382 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:59.242843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:59.243810 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:59.246395 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:57:59.375119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:59.383306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-766e44b3-1297-4ef7-b6a6-4b721f6c31b4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153549 Aug 31 19:57:59.383933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1040/2087] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:59 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:57:59.641636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:57:59.642281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:57:59.648676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:59.649152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:59.649590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:59.650280 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:57:59.650726 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:57:59.651182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:57:59.713908 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:57:59.722066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b36b1c52-ec67-4fa0-b05e-59407f87d5e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084327 Aug 31 19:57:59.722636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1048/2088] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:57:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:00.405797 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:00.406354 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:00.408674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=52 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:00.413476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:00.413968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:00.414412 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:00.415139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:00.415658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:00.416143 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:00.546647 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:00.554856 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c6b8b94e-d232-40a1-a24c-7ca74ea61563 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153054 Aug 31 19:58:00.555437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1041/2089] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:00 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:00.744663 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:00.745217 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:00.751668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:00.752152 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:00.752590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:00.753284 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:00.753740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:00.754170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:00.814641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:00.823803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5d649c49-0758-4ae7-8e5b-2bf5ba175bd8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083930 Aug 31 19:58:00.824377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1049/2090] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:01.576604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:01.577228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:01.583951 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:01.584437 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:01.584873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:01.585567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:01.586020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:01.586445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:01.713728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:01.721993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4819cd52-151e-4aac-a62a-5f88ef4382c4 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149639 Aug 31 19:58:01.722560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1042/2091] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:01 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:01.844784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:01.845400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:01.851866 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:01.852352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:01.853573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:01.854304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:01.854766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:01.855231 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:01.919010 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:01.927437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-62a54605-dbd2-45cb-bfd3-1fd518f69ee9 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086527 Aug 31 19:58:01.928009 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1050/2092] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:02.744774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:02.745374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:02.751825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:02.752310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:02.752749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:02.753447 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:02.753904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:02.754334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:02.882604 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:02.890975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-833580a4-c230-445d-96bf-0af6a1002f78 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150865 Aug 31 19:58:02.898482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1043/2093] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:02 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:02.948651 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:02.949285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:02.955673 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:02.956151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:02.956581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:02.957270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:02.957711 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:02.958133 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:02.962017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:03.018227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:03.027505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-778471c2-ce54-46a9-8010-7e0c294386c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083221 Aug 31 19:58:03.028070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1051/2094] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:03.911784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:03.912392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:03.920357 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:03.920854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:03.921331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:03.922044 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:03.922511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:03.922977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:04.057307 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:04.066375 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4edcb7a3-2483-4f93-8c4c-074642f80da9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158468 Aug 31 19:58:04.066961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1044/2095] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:03 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:04.101201 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:04.101821 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:04.104694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=54 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:04.109412 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:04.109966 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:04.110333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:04.111109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:04.111568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:04.111994 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:04.175727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:04.185564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7d04ba22-72c5-431c-b86d-aac284890d13 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.140458 Aug 31 19:58:04.186139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1052/2096] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:05.089554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:05.090161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:05.096614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:05.097123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:05.097543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:05.098244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:05.098705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:05.099170 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:05.206582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:05.207264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:05.214451 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:05.214961 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:05.215407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:05.216105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:05.216558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:05.216984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:05.229037 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:05.237230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-118df209-d3bb-4cbc-9383-22d98e277ec6 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152355 Aug 31 19:58:05.237812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1045/2097] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:05 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:05.279197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:05.287516 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cae5a43a-5b3b-4301-a6cf-1a699ec0c371 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084722 Aug 31 19:58:05.288084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1053/2098] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:05 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:06.258895 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:06.259676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:06.266330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:06.266822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:06.267326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:06.268060 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:06.268524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:06.268974 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:06.307868 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:06.308721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:06.315839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:06.316335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:06.316779 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:06.317765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:06.318226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:06.318661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:06.382739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:06.391890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-221747e5-abd1-418c-b717-f23aa079020c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087928 Aug 31 19:58:06.392446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1054/2099] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:06.405870 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:06.414157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e3382aa0-880d-4e4a-9a9b-0050b0c19845 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.159178 Aug 31 19:58:06.414723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1046/2100] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:06 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:07.414166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:07.415508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:07.422123 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:07.422686 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:07.423164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:07.423832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:07.424292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:07.424715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:07.436116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:07.436730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:07.445316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:07.445814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:07.446398 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:07.447476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:07.447943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:07.448378 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:07.487403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:07.496461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-99beeeb9-05c3-49ec-bdff-ceb99b64030e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086240 Aug 31 19:58:07.497051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1055/2101] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:07.577579 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:07.585752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e479de8b-fcc0-4e18-81d1-d4ec2deba6ea tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153970 Aug 31 19:58:07.586321 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1047/2102] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:07 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:08.517410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:08.518035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:08.524903 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:08.525438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:08.525833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:08.526542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:08.527103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:08.527539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:08.591333 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:08.599609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5488003d-2f11-4be7-974f-84964e1e5a0f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086303 Aug 31 19:58:08.600179 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1056/2103] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:08.608642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:08.609263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:08.615920 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:08.616404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:08.616840 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:08.617552 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:08.618606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:08.619173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:08.746364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:08.754517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-25429294-e452-4729-86d9-9b420e0a49c0 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149895 Aug 31 19:58:08.755108 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1048/2104] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:08 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:09.620904 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:09.621508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:09.628050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:09.628536 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:09.628982 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:09.629679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:09.630141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:09.630570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:09.694124 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:09.702894 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-425b4175-785d-454f-9f20-1f0963595820 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086015 Aug 31 19:58:09.703473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1057/2105] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:09.775997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:09.776607 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:09.783098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:09.783580 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:09.784017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:09.784706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:09.785163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:09.785582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:09.919729 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:09.927971 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-536ee520-6890-447f-a8fd-cfd58896552b tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.155810 Aug 31 19:58:09.928538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1049/2106] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:09 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:10.724522 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:10.725134 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:10.732507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:10.732990 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:10.733429 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:10.734126 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:10.734584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:10.735116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:10.795674 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:10.803805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-81b76136-929a-4a2c-9b25-e7d83ecbb07d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083144 Aug 31 19:58:10.804371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1058/2107] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:10.950219 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:10.950846 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:10.957366 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:10.957855 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:10.958296 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:10.959024 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:10.959489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:10.959922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:11.087944 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:11.096532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8fd99c2a-9e57-461c-bb7d-e2f98ba00531 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150806 Aug 31 19:58:11.097114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1050/2108] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:10 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:11.825023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:11.825635 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:11.832042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:11.832529 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:11.832962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:11.833646 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:11.834101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:11.834528 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:11.894703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:11.902834 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0167b757-b5dd-49c3-b63f-85deeaee0e89 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.081814 Aug 31 19:58:11.903428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1059/2109] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:12.117690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:12.118586 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:12.125084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:12.129141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:12.129141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:12.129141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:12.129141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:12.129657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:12.257780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:12.266121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2045cd1a-71b8-4ea2-8bf8-9bb43448e01f tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152396 Aug 31 19:58:12.266687 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1051/2110] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:12 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:12.924661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:12.925279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:12.932060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:12.932545 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:12.933237 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:12.933932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:12.934399 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:12.934833 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:12.998151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:13.006398 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-80f2ee83-7efb-421f-98be-c78773f8235c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085636 Aug 31 19:58:13.007162 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1060/2111] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:13.287894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:13.288512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:13.295446 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:13.295955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:13.296402 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:13.297114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:13.297573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:13.298065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:13.425386 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:13.433998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a1c1e4c1-ce31-4457-90e9-d436eaf02a49 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150042 Aug 31 19:58:13.434563 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1052/2112] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:13 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:14.027901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:14.028532 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:14.034854 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:14.035366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:14.035803 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:14.036497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:14.036952 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:14.037382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:14.097588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:14.106469 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-30e6a39e-f13f-4674-9163-9f576005fa5c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082745 Aug 31 19:58:14.107066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1061/2113] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:14.456078 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:14.456705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:14.463795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:14.464283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:14.464727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:14.465430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:14.465893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:14.466329 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:14.601752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:14.610661 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-79ebb846-6bf2-44fa-8a87-e17a5a4f3e61 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.158580 Aug 31 19:58:14.611256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1053/2114] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:14 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:15.131652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:15.132253 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:15.139286 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:15.139761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:15.140193 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:15.140876 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:15.141324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:15.141749 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:15.202956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:15.211039 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6b9cf816-d343-47fb-aac4-fbac6813851d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083237 Aug 31 19:58:15.211601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1062/2115] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:15.631674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:15.632292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:15.639524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:15.640266 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:15.640722 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:15.641426 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:15.641892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:15.642324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:15.777309 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:15.785583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-88e70bac-41b1-496a-8d4b-a2224dcb862e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.157818 Aug 31 19:58:15.786147 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1054/2116] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:15 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:16.232173 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:16.232933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:16.239382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:16.239871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:16.240316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:16.241015 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:16.241477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:16.241909 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:16.305200 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:16.313649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-971070d5-e91a-4ab8-ab80-7f9c2b5fbe60 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085359 Aug 31 19:58:16.314205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1063/2117] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:16 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:16.808176 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:16.808777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:16.815200 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:16.815685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:16.816128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:16.816820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:16.817280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:16.817708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:16.944967 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:16.953251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-42944acd-3379-4ab1-81e5-4e0e80d0362e tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.149973 Aug 31 19:58:16.953820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1055/2118] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:16 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:17.335829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:17.339988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:17.344379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:17.344976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:17.345439 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:17.346141 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:17.346682 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:17.347194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:17.411773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:17.421679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-461ffe4c-6c46-4255-a8ad-ecd9cb67ab8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090167 Aug 31 19:58:17.422254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1064/2119] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:17.974138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:17.974736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:17.981682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:17.982164 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:17.982599 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:17.983327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:17.983780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:17.984210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:18.115158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:18.117337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:18.124050 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6fa9dcd0-7760-4128-bde2-2b0e1dc9ee28 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.153776 Aug 31 19:58:18.124611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1056/2120] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:17 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:18.443872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:18.444508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:18.451498 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:18.451977 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:18.452405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:18.453089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:18.453539 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:18.453965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:18.514484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:18.522802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c8462ade-2ec7-4823-b3e5-da47680aad59 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082757 Aug 31 19:58:18.523440 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1065/2121] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:19.144824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:19.145477 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:19.152677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:19.153161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:19.153601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:19.154294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:19.154751 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:19.155216 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:19.284871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:19.293698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5b332e02-cf51-4a11-90b5-316b0c828aa1 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152747 Aug 31 19:58:19.294263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1057/2122] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:19 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:19.545046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:19.545652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:19.552271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:19.552755 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:19.553199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:19.553901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:19.554367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:19.554802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:19.633078 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:19.643419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dd97b9cf-6a44-471b-b32c-9b2242651d48 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.102345 Aug 31 19:58:19.644034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1066/2123] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:20.316047 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:20.316658 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:20.323818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:20.324297 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:20.324730 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:20.325413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:20.325871 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:20.326292 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:20.456745 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:20.465112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e1aede7e-c091-4c9a-9b9d-548bbbe72ec9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.152991 Aug 31 19:58:20.465710 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1058/2124] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:20 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:20.684107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:20.684717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:20.691430 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:20.691922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:20.692360 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:20.693053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:20.693510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:20.693940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:20.754865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:20.757037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=100 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:20.763842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f09e47a7-fae2-469f-970c-c622c5913241 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084761 Aug 31 19:58:20.764416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1067/2125] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:21.485795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:21.486417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:21.492885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:21.493522 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:21.493962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:21.494656 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:21.495141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:21.495576 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:21.624118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:21.632317 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-edb07773-3ae1-48c1-9cd5-311670610332 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.150647 Aug 31 19:58:21.632893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1059/2126] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:21 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:21.793130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:21.793696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:21.800586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:21.801068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:21.801499 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:21.802462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:21.802945 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:21.803370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:21.867046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:21.875655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-bde58f65-d5d1-4dde-97ae-77aadde7ff03 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086833 Aug 31 19:58:21.876248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1068/2127] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:22.654128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:22.654738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:22.661172 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:22.661659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:22.662098 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:22.662792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:22.663283 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:22.663713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:22.790334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:22.798738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dfb4133b-ca2e-40c6-b5d3-59d13f4eeb50 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.148458 Aug 31 19:58:22.799339 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1060/2128] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:22 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:22.897242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:22.897857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:22.904898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:22.905318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:22.905754 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:22.906447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:22.906915 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:22.907344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:22.968422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:22.976471 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-85188f5f-f31b-4050-a4f3-ceb607522f19 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083126 Aug 31 19:58:22.977044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1069/2129] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:23.819692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:23.820295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:23.826914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:23.827404 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:23.827903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:23.828600 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:23.829063 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:23.829497 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:23.961806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:23.970245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8ecc9300-2bd9-4144-bd23-148b494d10f7 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.154423 Aug 31 19:58:23.970821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1061/2130] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:23 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:23.997678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:23.998328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:24.004683 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:24.005177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:24.005602 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:24.006294 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:24.006748 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:24.007212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:24.070916 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:24.079403 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-de3255ec-9b35-4c50-b448-d9d6b40da089 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085692 Aug 31 19:58:24.080051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1070/2131] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:24.991598 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:24.992198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] [instance: 04ae84a4-2370-455d-9fbe-28a42a1f6ece] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:24.999259 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:24.999740 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:25.000175 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:25.000861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:25.001316 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:25.001738 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:25.100692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:25.101400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:25.108387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:25.108942 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:25.109493 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:25.110151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:25.110626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:25.111088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:25.130529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8214c2eb78f404d94bfc73ca7139e78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3374fda464574c07a137d5fe03b02712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:25.139503 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-71f27116-b302-41f7-b4a2-14e33108afa9 tempest-VolumesSnapshotTestJSON-659717290 tempest-VolumesSnapshotTestJSON-659717290-project] 10.222.0.59 "GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece" status: 200 len: 1558 microversion: 2.1 time: 0.151725 Aug 31 19:58:25.140089 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1062/2132] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:24 2022] GET /compute/v2.1/servers/04ae84a4-2370-455d-9fbe-28a42a1f6ece => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:25.173631 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:25.182897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-76bfb66c-9f8a-41ac-8325-9e25056f6c2a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085708 Aug 31 19:58:25.183912 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1071/2133] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:25 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:26.204715 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:26.205534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:26.212693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:26.213180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:26.213626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:26.214364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:26.214826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:26.215288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:26.279449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:26.288015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5beb79c6-3a8d-4797-ab33-5dd46d7b8902 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087690 Aug 31 19:58:26.288589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1063/2134] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:26 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:27.310164 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:27.310842 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:27.316891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:27.317400 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:27.317820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:27.318514 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:27.318999 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:27.319427 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:27.386363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:27.394713 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d8a6bc8d-ed5a-4902-938a-e59edf56ecdc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089739 Aug 31 19:58:27.395319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1072/2135] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:27 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:28.416018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:28.416655 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:28.422885 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:28.423380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:28.423815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:28.424510 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:28.425033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:28.425466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:28.486858 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:28.496198 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a53bd377-ddc0-415c-a3fb-0e898fbde951 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084046 Aug 31 19:58:28.496776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1064/2136] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:28 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:29.517859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:29.518472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:29.527737 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:29.528148 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:29.528585 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:29.529271 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:29.529899 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:29.530626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:29.594698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:29.604091 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-040537e3-074e-412a-a2d7-764970a0ebf7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090020 Aug 31 19:58:29.604718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1073/2137] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:29 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:30.625059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:30.625818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:30.629263 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=48 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:30.632630 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:30.633118 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:30.633646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:30.634350 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:30.634804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:30.635323 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:30.700849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:30.709162 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-4135dd2e-3c0b-4121-b519-3dfb4a3cc098 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088067 Aug 31 19:58:30.709727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1065/2138] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:30 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:31.729610 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:31.730223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:31.737344 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:31.737819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:31.738263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:31.739056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:31.739517 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:31.739950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:31.801530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:31.810752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f9fea0d1-105e-41cd-aae6-91ecb79f4579 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085061 Aug 31 19:58:31.811356 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1074/2139] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:32.832389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:32.832995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:32.840239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:32.840955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:32.841282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:32.842000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:32.842440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:32.842917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:32.908013 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:32.916894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-25d9d3c2-6afc-4d51-99ad-5331cf60a6a7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088402 Aug 31 19:58:32.921233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1066/2140] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:32 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:33.938761 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:33.939421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:33.946042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:33.946477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:33.946939 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:33.947649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:33.948110 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:33.948540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:34.011786 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:34.020040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b67afbc7-5b8b-41ef-a8c9-39f3814ac65c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085203 Aug 31 19:58:34.025840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1075/2141] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:33 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:35.041904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:35.042535 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:35.049377 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:35.049916 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:35.050347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:35.051087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:35.051549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:35.051987 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:35.118488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:35.127794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-42b48671-4b96-4678-8f30-62260e3c122c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089892 Aug 31 19:58:35.128467 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1067/2142] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:35 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:36.150485 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:36.151120 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:36.152920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=48 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:36.157553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:36.158032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:36.158462 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:36.159170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:36.159619 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:36.166678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:36.225572 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:36.234596 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5a765929-42ed-4c54-801b-66e65403c54b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089006 Aug 31 19:58:36.235199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1076/2143] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:36 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:37.254839 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:37.255469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:37.262301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:37.262784 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:37.263253 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:37.263958 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:37.264418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:37.264853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:37.329699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:37.338815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-8c078d8d-e367-46c8-b002-838b519a29d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.087807 Aug 31 19:58:37.347905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1068/2144] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:37 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:38.360636 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:38.361251 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:38.369049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:38.369537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:38.369980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:38.370684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:38.371166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:38.371601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:38.436943 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:38.445328 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-97bc63c1-6888-4d24-935b-cd2011605085 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088545 Aug 31 19:58:38.453709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1077/2145] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:38 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:39.466904 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:39.467530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:39.474714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:39.475239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:39.475922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:39.476742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:39.477096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:39.477533 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:39.541690 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:39.550014 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-744635bc-e3b8-462f-a4a9-49813728c3a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086996 Aug 31 19:58:39.550577 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1069/2146] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:39 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:40.573374 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:40.574011 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:40.580526 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:40.581017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:40.581460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:40.582171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:40.582634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:40.583088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:40.644212 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:40.652589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5c868413-bb78-4c5b-b1e5-94b92400affc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083818 Aug 31 19:58:40.653163 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1078/2147] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:40 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:41.673823 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:41.674435 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:41.681207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:41.681702 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:41.682144 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:41.683140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:41.683611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:41.684093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:41.746821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:41.755448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6171d0da-3f83-4969-8bdc-f9cfbe562b1f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085551 Aug 31 19:58:41.756017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1070/2148] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:41 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:42.777822 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:42.778455 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:42.785443 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:42.785926 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:42.786367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:42.787100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:42.787557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:42.787986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:42.849075 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:42.857850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c300be6d-2299-4aac-880f-a99132f03454 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084548 Aug 31 19:58:42.858422 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1079/2149] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:42 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:43.878852 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:43.879502 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:43.886210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:43.886704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:43.887180 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:43.887892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:43.888387 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:43.888824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:43.953240 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:43.961473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d043bbf8-e316-4ca3-9325-06e9566dd69c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086500 Aug 31 19:58:43.962038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1071/2150] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:43 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:44.983042 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:44.983655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:44.990632 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:44.991146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:44.991590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:44.992291 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:44.992753 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:44.993194 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:45.060562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:45.069136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-60c5424d-512e-4b0f-a930-8b557d121756 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.090527 Aug 31 19:58:45.069747 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1080/2151] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:44 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:46.092320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:46.092945 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:46.099469 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:46.099953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:46.100396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:46.101099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:46.101560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:46.101997 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:46.163213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:46.172009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6a28105b-7ac5-4224-9ad8-9df04a09f2a2 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083799 Aug 31 19:58:46.174720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1072/2152] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:46 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:47.193119 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:47.193818 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:47.200789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:47.201303 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:47.201747 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:47.202453 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:47.202940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:47.203376 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:47.265534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:47.273949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2442b253-88b8-49a0-988e-379084a3f6fe tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084661 Aug 31 19:58:47.274527 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1081/2153] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:47 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:48.296767 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:48.297444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:48.304400 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:48.304893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:48.305496 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:48.306310 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:48.306776 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:48.307499 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:48.328778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=100 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:48.377720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:48.386734 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c9f40b1f-325d-4e08-b8af-7316b8993dcb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.094554 Aug 31 19:58:48.387355 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1073/2154] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:48 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:49.409479 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:49.410090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:49.416921 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:49.417413 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:49.417856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:49.418678 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:49.419805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:49.420373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:49.488922 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:49.497712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4051080f-eb9d-4971-96e2-bd91922d4858 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.092226 Aug 31 19:58:49.498319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1082/2155] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:49 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:50.519700 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:50.520414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:50.527359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:50.527866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:50.528418 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:50.529326 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:50.529921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:50.530482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:50.595006 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:50.604440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1c164b4a-41c1-41de-a5ad-d93069a75e9a tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089201 Aug 31 19:58:50.605009 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1074/2156] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:50 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:51.629279 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:51.629897 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:51.636530 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:51.637023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:51.637467 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:51.638206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:51.638668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:51.639127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:51.711829 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:51.720321 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8773269f-136e-4980-8930-4b65a92962af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.095023 Aug 31 19:58:51.720889 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1083/2157] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:51 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:52.741493 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:52.742095 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:52.748706 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:52.749150 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:52.749594 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:52.750313 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:52.750752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:52.751241 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:52.814793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:52.823211 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b4e5fb1e-9b07-4f9b-b7ac-d979d38bb242 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085692 Aug 31 19:58:52.823787 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1075/2158] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:52 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:58:53.845608 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:53.846248 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:53.852741 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:53.853227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:53.853670 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:53.854369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:53.854830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:53.855304 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:53.859871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=98 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:58:53.918387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:53.927570 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3fec649a-1ea0-4145-8515-ad9b84cd9b58 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086352 Aug 31 19:58:53.928143 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1084/2159] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:53 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:54.949199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:54.949794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:54.956814 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:54.957294 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:54.957727 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:54.958413 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:54.958892 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:54.959319 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:55.021100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:55.029857 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-83e4e787-179e-454f-9efb-ac65cb3ebafa tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084451 Aug 31 19:58:55.030538 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1076/2160] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:54 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:56.052285 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:56.052931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:56.059166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:56.059647 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:56.060080 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:56.060773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:56.061223 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:56.061649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:56.125314 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:56.133752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-325ed13a-56ea-4c5a-9687-f58a99338828 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085618 Aug 31 19:58:56.134331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1085/2161] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:56 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:57.157208 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:57.157896 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:57.164742 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:57.165233 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:57.165670 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:57.166371 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:57.166826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:57.167494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:57.236881 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:57.245741 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-c7f11b23-723b-44e3-932e-0a8c4ed7f6e0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.093594 Aug 31 19:58:57.246340 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1077/2162] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:57 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:58.267789 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:58.268519 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:58.274946 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:58.275432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:58.275871 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:58.276568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:58.277014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:58.277437 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:58.340714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:58.349877 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2d1c5444-af98-42e5-a647-03f45ba64934 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085995 Aug 31 19:58:58.350508 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1086/2163] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:58 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:58:59.374444 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:58:59.375065 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:58:59.381649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:59.382132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:59.382567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:59.383295 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:58:59.383750 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:58:59.384181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:58:59.447420 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:58:59.456036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-9d0775e0-e36d-4842-92ee-478d49b71303 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086821 Aug 31 19:58:59.456602 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1078/2164] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:58:59 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:00.477525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:00.478095 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:00.484484 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:00.484968 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:00.485410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:00.486105 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:00.486566 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:00.487023 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:00.547768 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:00.556111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6428f62b-4be6-4d93-b01b-bf50def9dc0c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082848 Aug 31 19:59:00.556690 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1087/2165] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:00 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:01.578187 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:01.578788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:01.581101 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=28 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:01.586696 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:01.589588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:01.589588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:01.589588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:01.589588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:01.590023 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:01.658380 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:01.667676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6e539144-c811-4bae-bd0b-b3188099f4c6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.093478 Aug 31 19:59:01.668256 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1079/2166] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:01 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:02.689053 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:02.689677 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:02.696907 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:02.697402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:02.697844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:02.698557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:02.699052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:02.699491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:02.765852 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:02.774848 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dd925478-ff6d-4fb1-a711-93565cd34625 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089526 Aug 31 19:59:02.775463 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1088/2167] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:02 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:03.797221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:03.797818 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:03.805193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:03.805682 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:03.806126 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:03.806827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:03.807566 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:03.807998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:03.872623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:03.881924 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-74ec9716-247f-4877-9acd-c38da8bae7c0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088578 Aug 31 19:59:03.882494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1080/2168] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:03 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:04.903708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:04.904313 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:04.910752 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:04.911334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:04.911948 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:04.919661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:04.919661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:04.919661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:04.976242 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:04.984924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4c7c31e0-8ef3-42ef-875e-0d7cc48f5ab6 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084989 Aug 31 19:59:04.985509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1089/2169] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:04 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:06.007246 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:06.007809 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:06.010178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:59:06.010328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:59:06.011334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:59:06.011505 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:59:06.012617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:59:06.012617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 19:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:59:06.022726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:06.023568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:06.024160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:06.024940 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:06.025405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:06.025841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:06.088652 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:06.096777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-52711264-4027-4dd0-91ba-9635f6bb38b5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.093518 Aug 31 19:59:06.097347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1081/2170] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:06 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:07.118739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:07.119370 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:07.121335 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:59:07.121470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:59:07.122474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:59:07.122588 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:59:07.123506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 19:59:07.123655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 19:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 19:59:07.124964 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=28 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:07.134301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:07.134798 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:07.135274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:07.135989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:07.136450 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:07.136881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:07.202292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:07.211470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-ba5d909f-ae7a-4519-bebb-2692aba301a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.097261 Aug 31 19:59:07.212044 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1090/2171] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:07 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:08.233054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:08.233675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:08.241230 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:08.241720 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:08.242173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:08.242893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:08.243359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:08.243794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:08.305589 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:08.314109 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-15ae3093-20f5-4f49-b56b-a6a96dadfa17 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084927 Aug 31 19:59:08.314679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1082/2172] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:08 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:09.335760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:09.336371 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:09.342805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:09.343324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:09.343764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:09.344458 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:09.344913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:09.345343 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:09.405931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:09.414158 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0d75d56d-55ab-4609-8944-0092a033be4b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.082970 Aug 31 19:59:09.414728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1091/2173] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:09 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:10.435906 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:10.436635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:10.443739 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:10.444232 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:10.444678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:10.445379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:10.445842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:10.446276 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:10.509721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:10.517926 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5b116a06-a991-4212-8cc7-cd01f9a545f8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.086286 Aug 31 19:59:10.518488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1083/2174] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:10 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:11.539473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:11.540016 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:11.546392 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:11.546890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:11.547342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:11.548033 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:11.548487 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:11.548913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:11.613936 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:11.623138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-eed425ef-92af-4f22-a65c-cac235d55583 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088295 Aug 31 19:59:11.623710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1092/2175] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:11 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:12.644036 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:12.644704 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:12.651277 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:12.651758 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:12.652197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:12.652888 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:12.653344 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:12.653772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:12.715540 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:12.723815 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-73e27aaa-7fa7-4826-b7a2-011ca2b7641f tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083672 Aug 31 19:59:12.724943 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1084/2176] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:12 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:59:13.745783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:13.746405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:13.752891 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:13.753379 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:13.753820 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:13.754520 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:13.755013 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:13.755979 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:13.816986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:13.826341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-739eb24f-61c6-43b9-af37-a68fa74ea8a0 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.084373 Aug 31 19:59:13.826950 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1093/2177] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:13 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:14.847221 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:14.847842 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:14.855218 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:14.855705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:14.856151 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:14.856847 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:14.857305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:14.857737 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:14.918683 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:14.926849 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-99b07abf-f957-4ae6-b537-de3574be2841 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083567 Aug 31 19:59:14.927583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1085/2178] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:14 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:59:15.948718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:15.949329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:15.955720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:15.956199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:15.956633 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:15.957319 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:15.958109 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:15.958590 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:16.019629 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:16.028634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7cbdb7b9-9c40-4f4f-b9cd-030d4ad9197d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083824 Aug 31 19:59:16.029206 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1094/2179] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:15 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:17.049487 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:17.050123 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:17.057255 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:17.057769 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:17.058237 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:17.058963 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:17.059419 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:17.059844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:17.122512 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:17.130679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-b7cb8cab-a435-443b-bd21-c1905ca3ddcf tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.085058 Aug 31 19:59:17.131282 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1086/2180] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:17 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:18.152160 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:18.152775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:18.159144 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:18.159620 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:18.160049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:18.160733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:18.161182 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:18.161666 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:18.221816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:18.229955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-fe9f679d-7ee8-41b1-bc66-9f04b0a5bf5b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.081636 Aug 31 19:59:18.230507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1095/2181] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:18 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:19.250097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:19.250713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:19.257548 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:19.258038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:19.258479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:19.259201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:19.259659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:19.260086 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:19.263968 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=82 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:19.325994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:19.334827 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d4c12f11-1647-4dbd-ba4e-5f12ec5a02d5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.088623 Aug 31 19:59:19.335417 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1087/2182] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:19 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:20.356222 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:20.356840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:20.363409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:20.363898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:20.364342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:20.365700 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:20.366157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:20.366591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:20.433928 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:20.442064 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6ecbf5c9-0a3c-4024-8984-2db9d2bcc097 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.089826 Aug 31 19:59:20.442630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1096/2183] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:20 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:21.465754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:21.466360 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:21.472860 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:21.473348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:21.473793 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:21.475304 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:21.475611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:21.476045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:21.793212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:21.801491 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-66e6ed12-0030-4081-9481-a7fb2b510b39 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.339744 Aug 31 19:59:21.802134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1088/2184] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:21 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:22.824060 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:22.824707 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:22.831367 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:22.831847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:22.832281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:22.832965 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:22.833507 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:22.834676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:22.894563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:22.903580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6b9fe9be-421c-4055-8b3a-4e97c25132df tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083297 Aug 31 19:59:22.904138 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1097/2185] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:22 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 19:59:23.924804 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:23.925409 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:23.932678 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:23.933898 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:23.934345 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:23.935080 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:23.935547 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:23.935984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:23.996392 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:24.004646 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-829eafa8-61a2-4277-9ea3-4fa4596e2423 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 200 len: 1371 microversion: 2.1 time: 0.083889 Aug 31 19:59:24.006029 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1089/2186] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:23 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:24.026603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e88c1732-e5e3-4ceb-bd6b-599b12e522af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '.version_select at 0x7ff6cb3a0f70>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:24.145827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e88c1732-e5e3-4ceb-bd6b-599b12e522af tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-967058329" status: 202 len: 0 microversion: 2.1 time: 0.122930 Aug 31 19:59:24.146419 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1098/2187] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 31 19:59:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-967058329 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 19:59:25.084229 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a13f0355-9e7f-462b-af69-70e01f396bcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: .version_select at 0x7ff6ced67790>, body: {"keypair": {"name": "tempest-keypair-1255420893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzrQTAO4OPCI8KRlGTMO9rPyPccc5SDQ9MHVNQgRN8w/aBwREiW70eiRlSt0BUPJ7vfzD89T077aeeGw/ELN6P3aHOjsxIfDjl54Um/+FT4gvPXrSy+WyaJNhH+NmxeCg=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:59:25.101606 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-a13f0355-9e7f-462b-af69-70e01f396bcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:59:25.105933 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-a13f0355-9e7f-462b-af69-70e01f396bcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:59:25.211251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a13f0355-9e7f-462b-af69-70e01f396bcd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130865 Aug 31 19:59:25.211925 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1090/2188] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 19:59:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:59:27.460155 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1680628398", "imageRef": "23403e81-adde-4d3c-9acb-58973cd5d455", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e"}], "security_groups": [{"name": "tempest-securitygroup--536783044"}], "key_name": "tempest-keypair-1255420893", "user_data": "}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:59:27.567784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] validate_networks() for [('acb4e101-a7e8-4be0-9a6c-9e046c7c4b4e', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 19:59:27.991537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 19:59:27.991956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 19:59:27.992446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 19:59:27.992837 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 19:59:27.993244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 19:59:28.002051 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:28.002525 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:28.002997 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:28.003719 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:28.004166 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:28.004586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:28.010497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=84 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:28.023409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 19:59:28.027513 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Getting quotas for user 991f6d49ad014318bc9c2f5d57b9deb7 and project dc120bdcb47d4b1b872e2132b8ee9f2e. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 19:59:28.038641 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 19:59:28.041038 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='23403e81-adde-4d3c-9acb-58973cd5d455',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 19:59:28.212336 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-452d15e7-6a5f-4c58-9487-8d5bee4bedc5 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.757108 Aug 31 19:59:28.212988 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1099/2189] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 19:59:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 19:59:28.226735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-72e951e2-ab2e-4d55-bed9-18abfee4b32c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:28.227388 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-72e951e2-ab2e-4d55-bed9-18abfee4b32c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:28.283851 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-72e951e2-ab2e-4d55-bed9-18abfee4b32c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:28.293816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-72e951e2-ab2e-4d55-bed9-18abfee4b32c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1242 microversion: 2.1 time: 0.073123 Aug 31 19:59:28.294705 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1091/2190] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:28 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:29.315955 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:29.316624 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:29.323583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:29.324068 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:29.324533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:29.325230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:29.325687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:29.326114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:29.394607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:29.403116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-dcc7b61d-85e1-455a-9cd2-5e96735964d8 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1246 microversion: 2.1 time: 0.091439 Aug 31 19:59:29.403693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1100/2191] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:29 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:30.424628 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:30.425254 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:30.432320 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:30.432806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:30.433250 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:30.433955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:30.434414 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:30.434844 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:30.497812 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:30.505517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-f0a322af-6eda-4562-9833-ad3d011fcd66 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1294 microversion: 2.1 time: 0.085038 Aug 31 19:59:30.508072 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1092/2192] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:30 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:31.525614 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:31.526380 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:31.533215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:31.533702 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:31.534132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:31.534830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:31.535793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:31.535793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:31.604696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:31.611366 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-256a2975-65ac-4fb1-877e-79476c0cc34d tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1300 microversion: 2.1 time: 0.089565 Aug 31 19:59:31.611960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1101/2193] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:31 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:32.635415 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:32.636004 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:32.638285 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:32.642994 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:32.643490 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:32.643980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:32.644685 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:32.645148 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:32.645583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:32.821331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:32.838198 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-04f519c5-8ccd-4433-b2d5-4648c2132729 req-dab513cb-d243-48cf-bae6-ebf2b0583a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9325f8-6461-4408-8b4b-5dbdbbd91cb7", "tag": "03ab491d-f17f-43f5-aa96-e4ba28ed2930"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:59:32.838828 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-24779cc6-1122-49a4-9393-bfea7acdae8e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.207443 Aug 31 19:59:32.839825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1093/2194] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:32 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:32.849205 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-04f519c5-8ccd-4433-b2d5-4648c2132729 req-dab513cb-d243-48cf-bae6-ebf2b0583a83 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:32.849765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-04f519c5-8ccd-4433-b2d5-4648c2132729 req-dab513cb-d243-48cf-bae6-ebf2b0583a83 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:32.850273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-04f519c5-8ccd-4433-b2d5-4648c2132729 req-dab513cb-d243-48cf-bae6-ebf2b0583a83 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:32.863282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-04f519c5-8ccd-4433-b2d5-4648c2132729 req-dab513cb-d243-48cf-bae6-ebf2b0583a83 service nova] Creating event network-changed:03ab491d-f17f-43f5-aa96-e4ba28ed2930 for instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 on hv-cinder-85220 Aug 31 19:59:32.869421 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-04f519c5-8ccd-4433-b2d5-4648c2132729 req-dab513cb-d243-48cf-bae6-ebf2b0583a83 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104532 Aug 31 19:59:32.870052 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1102/2195] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 19:59:33.860252 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:33.860874 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:33.867995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:33.868590 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:33.869160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:33.869616 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:33.870079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:33.870507 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:34.000693 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:34.009139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-07d0f57f-5935-4d50-8d5f-447b0ced505b tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.152663 Aug 31 19:59:34.009719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1094/2196] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:33 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:35.031207 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:35.031913 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:35.038137 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:35.038630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:35.039107 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:35.039816 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:35.040278 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:35.040712 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:35.170292 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:35.177949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-df073d56-2b8f-4bf5-932b-49d39f2ff453 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.151812 Aug 31 19:59:35.179057 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1103/2197] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:35 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:36.198975 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:36.199603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:36.206135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:36.206674 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:36.207106 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:36.207816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:36.208286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:36.208724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:36.432434 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:36.440157 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5bc37121-74be-4eb4-83e4-b1c696036abc tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.245079 Aug 31 19:59:36.440733 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1095/2198] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:36 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:37.461386 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:37.462026 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:37.464557 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:37.469382 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:37.469895 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:37.470389 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:37.471130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:37.471586 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:37.472111 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:37.604262 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:37.612136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-9c3809c1-0c92-4783-8e2c-dd9da0a7a895 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.155067 Aug 31 19:59:37.612718 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1104/2199] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:37 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:38.633866 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:38.634480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:38.636732 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=6 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:38.641712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:38.642128 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:38.642565 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:38.643288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:38.643752 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:38.644171 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:38.771396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:38.779640 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a949cb13-6e34-49fe-b01d-6b90526c7189 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.149760 Aug 31 19:59:38.780213 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1096/2200] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:38 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:39.089951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:39.090839 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 19:59:39.144887 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-5e70bcfd-7ef6-4667-977a-54485725d05b req-4451d131-2020-40f2-8792-9b520f763a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9325f8-6461-4408-8b4b-5dbdbbd91cb7", "name": "network-vif-plugged", "status": "completed", "tag": "03ab491d-f17f-43f5-aa96-e4ba28ed2930"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:59:39.154694 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5e70bcfd-7ef6-4667-977a-54485725d05b req-4451d131-2020-40f2-8792-9b520f763a66 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:39.155263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5e70bcfd-7ef6-4667-977a-54485725d05b req-4451d131-2020-40f2-8792-9b520f763a66 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:39.155687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-5e70bcfd-7ef6-4667-977a-54485725d05b req-4451d131-2020-40f2-8792-9b520f763a66 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:39.169826 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-5e70bcfd-7ef6-4667-977a-54485725d05b req-4451d131-2020-40f2-8792-9b520f763a66 service nova] Creating event network-vif-plugged:03ab491d-f17f-43f5-aa96-e4ba28ed2930 for instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 on hv-cinder-85220 Aug 31 19:59:39.175100 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-5e70bcfd-7ef6-4667-977a-54485725d05b req-4451d131-2020-40f2-8792-9b520f763a66 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090472 Aug 31 19:59:39.175873 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1105/2201] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:59:39.800998 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:39.801534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:39.808996 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:39.809488 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:39.809934 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:39.810636 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:39.811161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:39.811597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:39.940726 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:39.948442 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-33b27199-5dbf-47e7-9536-0be1f24cabeb tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.151476 Aug 31 19:59:39.949007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1097/2202] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:39 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:40.973416 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:40.974103 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:40.981692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:40.982170 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:40.982607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:40.983331 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:40.983781 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:40.984203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:41.117612 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:41.125273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-37489d1d-ae01-4c47-8069-cbe694b8711c tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1367 microversion: 2.1 time: 0.156849 Aug 31 19:59:41.125847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1106/2203] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:40 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:42.146643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:42.147330 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:42.154048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:42.154532 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:42.155015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:42.155723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:42.156184 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:42.156617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:42.285609 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 19:59:42.294531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0099fa1f-1edf-4bb7-afd9-262341d00d71 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1557 microversion: 2.1 time: 0.151741 Aug 31 19:59:42.295134 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1098/2204] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 19:59:42 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 19:59:42.315387 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 19:59:42.315923 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 19:59:42.322594 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:42.323116 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:42.323558 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:42.324252 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:42.324710 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:42.325157 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:42.402533 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-27a4703d-6fa2-43d9-9fef-2acf5b23f5bd tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090895 Aug 31 19:59:42.403180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1107/2205] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 31 19:59:42 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 19:59:43.427780 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-d243afdb-1cbe-4d82-b8a9-fbaeb1575131 req-bd3fce27-34d6-4b78-9268-4f10f620033a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b9325f8-6461-4408-8b4b-5dbdbbd91cb7", "tag": "03ab491d-f17f-43f5-aa96-e4ba28ed2930"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 19:59:43.438981 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-d243afdb-1cbe-4d82-b8a9-fbaeb1575131 req-bd3fce27-34d6-4b78-9268-4f10f620033a service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 19:59:43.439479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-d243afdb-1cbe-4d82-b8a9-fbaeb1575131 req-bd3fce27-34d6-4b78-9268-4f10f620033a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 19:59:43.439922 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-d243afdb-1cbe-4d82-b8a9-fbaeb1575131 req-bd3fce27-34d6-4b78-9268-4f10f620033a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 19:59:43.455155 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-d243afdb-1cbe-4d82-b8a9-fbaeb1575131 req-bd3fce27-34d6-4b78-9268-4f10f620033a service nova] Creating event network-changed:03ab491d-f17f-43f5-aa96-e4ba28ed2930 for instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 on hv-cinder-85220 Aug 31 19:59:43.463476 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-d243afdb-1cbe-4d82-b8a9-fbaeb1575131 req-bd3fce27-34d6-4b78-9268-4f10f620033a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096109 Aug 31 19:59:43.464099 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1099/2206] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 19:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:00:57.369836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=7 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:00:57.371121 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=39 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:00:57.375693 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:00:57.379215 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:00:57.383149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:00:57.383634 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:00:57.384074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:00:57.384774 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:00:57.385229 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:00:57.385660 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:00:57.409293 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-26eccd5b-f861-4ab0-8400-5c373875f8f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7/ips" status: 200 len: 149 microversion: 2.1 time: 0.041474 Aug 31 20:00:57.410433 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1108/2207] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 31 20:00:57 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:01:27.431583 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=13 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:01:27.432626 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=61 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:01:27.437473 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-67deceea-a779-4c8e-b19c-31e73b0134ed req-ea654aad-f1a6-4447-832e-a3b305cfc132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ae84a4-2370-455d-9fbe-28a42a1f6ece", "name": "network-vif-deleted", "tag": "17ba8c5b-a884-442e-be78-ed41d9f6fe68"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:01:27.448202 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-67deceea-a779-4c8e-b19c-31e73b0134ed req-ea654aad-f1a6-4447-832e-a3b305cfc132 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:01:27.448754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-67deceea-a779-4c8e-b19c-31e73b0134ed req-ea654aad-f1a6-4447-832e-a3b305cfc132 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:01:27.449243 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-67deceea-a779-4c8e-b19c-31e73b0134ed req-ea654aad-f1a6-4447-832e-a3b305cfc132 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:01:27.460824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-67deceea-a779-4c8e-b19c-31e73b0134ed req-ea654aad-f1a6-4447-832e-a3b305cfc132 service nova] Creating event network-vif-deleted:17ba8c5b-a884-442e-be78-ed41d9f6fe68 for instance 04ae84a4-2370-455d-9fbe-28a42a1f6ece on hv-cinder-85220 Aug 31 20:01:27.466096 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-67deceea-a779-4c8e-b19c-31e73b0134ed req-ea654aad-f1a6-4447-832e-a3b305cfc132 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036745 Aug 31 20:01:27.466960 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1100/2208] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:07:26.230775 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 20:07:26.231589 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:07:26.231736 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 (ip 10.222.0.59) !!! Aug 31 20:07:26.233352 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:07:26.233476 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 (ip 10.222.0.59) !!! Aug 31 20:07:26.234428 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:07:26.234534 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 (ip 10.222.0.59) !!! Aug 31 20:07:26.240315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:07:26.241086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:07:26.250930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:26.251415 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:26.251856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:26.252582 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:26.253035 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:26.253460 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:26.281473 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 20:07:26.523088 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4469712d-7920-49aa-9888-8f08cfe15e99 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 204 len: 0 microversion: 2.1 time: 0.294513 Aug 31 20:07:26.523580 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1109/2209] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 20:07:26 2022] DELETE /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 20:07:26.530132 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR oslo.messaging._drivers.impl_rabbit [-] [966a511b-72de-4381-9d8a-e99fd46e459d] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 20:07:26.531884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:07:26.532038 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 (ip 10.222.0.59) !!! Aug 31 20:07:26.533953 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:07:26.534077 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 (ip 10.222.0.59) !!! Aug 31 20:07:26.535463 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:07:26.535588 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 (ip 10.222.0.59) !!! Aug 31 20:07:26.541397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:07:26.542178 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:07:26.563193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:26.563677 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:26.564215 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:26.564862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:26.565348 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:26.565774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:26.844619 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:07:26.853161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-0404c81e-14d8-45a4-a557-1b534d7fdb18 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1681 microversion: 2.1 time: 0.325070 Aug 31 20:07:26.853725 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1101/2210] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:07:26 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:07:27.874230 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:07:27.875146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:07:27.883049 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:27.883584 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:27.884028 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:27.884797 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:27.885288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:27.885746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:27.892850 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 42482. Aug 31 20:07:28.078301 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:07:28.087127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3e5d1b2f-d1df-4ee2-9ac8-17aa07b773f7 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1681 microversion: 2.1 time: 0.217093 Aug 31 20:07:28.087701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1110/2211] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:07:27 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:07:28.623701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] [966a511b-72de-4381-9d8a-e99fd46e459d] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 42492. Aug 31 20:07:28.695972 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-0619ff80-cc3b-4ad9-8bfe-4328c4750a77 req-75e11c18-892e-4e54-b004-e78ff27a505b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b9325f8-6461-4408-8b4b-5dbdbbd91cb7", "name": "network-vif-deleted", "tag": "03ab491d-f17f-43f5-aa96-e4ba28ed2930"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:07:28.706774 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-0619ff80-cc3b-4ad9-8bfe-4328c4750a77 req-75e11c18-892e-4e54-b004-e78ff27a505b service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:28.707821 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-0619ff80-cc3b-4ad9-8bfe-4328c4750a77 req-75e11c18-892e-4e54-b004-e78ff27a505b service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:28.708884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-0619ff80-cc3b-4ad9-8bfe-4328c4750a77 req-75e11c18-892e-4e54-b004-e78ff27a505b service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:28.722982 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-0619ff80-cc3b-4ad9-8bfe-4328c4750a77 req-75e11c18-892e-4e54-b004-e78ff27a505b service nova] Creating event network-vif-deleted:03ab491d-f17f-43f5-aa96-e4ba28ed2930 for instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 on hv-cinder-85220 Aug 31 20:07:28.730893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-0619ff80-cc3b-4ad9-8bfe-4328c4750a77 req-75e11c18-892e-4e54-b004-e78ff27a505b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123360 Aug 31 20:07:28.734139 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1102/2212] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:07:29.108342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:07:29.110978 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:07:29.117006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:29.117506 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:29.117938 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:29.118644 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:29.119281 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:29.119704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:29.153167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:29.153652 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:29.154086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:29.154535 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lazy-loading 'fault' on Instance uuid 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 20:07:29.198276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '991f6d49ad014318bc9c2f5d57b9deb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc120bdcb47d4b1b872e2132b8ee9f2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:07:29.206112 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-58955d81-924f-4223-b9d1-4a51b99b703e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 200 len: 1332 microversion: 2.1 time: 0.101544 Aug 31 20:07:29.206684 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1111/2213] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:07:29 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:07:30.229623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:07:30.230235 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:07:30.236913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:30.237389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:30.237820 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:30.238509 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:07:30.238993 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:07:30.240177 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:07:30.253657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 HTTP/1.1 Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 20:07:30.255396 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:07:30.256792 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '7b9325f8-6461-4408-8b4b-5dbdbbd91cb7'} Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:07:30.257560 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:07:30.258862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:07:30.260328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:07:30.260328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-de5843ae-e788-489e-b658-9593f531fd22 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 404 len: 111 microversion: 2.1 time: 0.031519 Aug 31 20:07:30.260638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1103/2214] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:07:30 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:07:30.265795 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6f81c132-28f8-41e6-a2a1-7e63c2361602 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '.version_select at 0x7ff6cb5aeb80>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:07:30.336131 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6f81c132-28f8-41e6-a2a1-7e63c2361602 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255420893" status: 202 len: 0 microversion: 2.1 time: 0.074077 Aug 31 20:07:30.336757 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1112/2215] 10.222.0.59 () {58 vars in 1221 bytes} [Wed Aug 31 20:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255420893 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 20:12:14.562120 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR oslo.messaging._drivers.impl_rabbit [-] [966a511b-72de-4381-9d8a-e99fd46e459d] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 20:12:14.562995 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=8 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:14.563861 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=12 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:14.565805 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:12:14.565957 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:12:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.59) !!! Aug 31 20:12:14.567470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:12:14.567596 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:12:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.59) !!! Aug 31 20:12:14.569760 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:12:14.569872 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:12:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.59) !!! Aug 31 20:12:14.790352 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-6e075320-3f5d-43c0-9a78-2a542d70c54c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Action: 'create', calling method: .version_select at 0x7ff6cb333040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1656850468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9J9z7+eBFon4olRpO//Q0hCrXRu+i1VJ0tYvLlcs47GXy043blGENWv7yNmFOSyDbXdt0o8U+0CyNWkZQZ7hVsHhQCilyTPcV5zWOobdsZtl4KqLAzvu1iLwaHYHQvsA=="}} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:12:14.807639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6e075320-3f5d-43c0-9a78-2a542d70c54c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Getting quotas for project 21718c5f45b74854bd0a487939a0bd23. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 20:12:14.811695 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.quota [None req-6e075320-3f5d-43c0-9a78-2a542d70c54c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Getting quotas for user 7b585708ea6446e398c45196e9a992ac and project 21718c5f45b74854bd0a487939a0bd23. Resources: {'key_pairs'} {{(pid=121187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 20:12:14.881854 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-6e075320-3f5d-43c0-9a78-2a542d70c54c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.321670 Aug 31 20:12:14.882539 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1104/2216] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 31 20:12:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:12:41.095727 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 20:12:41.096298 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:41.097070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:41.098568 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:12:41.098697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Aug 31 20:12:41.099874 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:12:41.100007 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Aug 31 20:12:41.101073 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:12:41.101184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Aug 31 20:12:41.110114 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1993092923", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1656850468", "security_groups": [{"name": "tempest-secgroup-smoke-648881642"}], "networks": [{"uuid": "854ee9a1-753b-4594-91cc-ee53e5c98f75"}], "block_device_mapping_v2": [{"uuid": "9a6fa48e-1160-46a8-b2fc-792caa37c1df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:12:41.344650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.network.neutron [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] validate_networks() for [('854ee9a1-753b-4594-91cc-ee53e5c98f75', None, None, None, None, None)] {{(pid=121186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 20:12:41.814481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Flavor limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 20:12:41.814929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Image limits 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 20:12:41.815405 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Flavor pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 20:12:41.815810 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Image pref 0:0:0 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 20:12:41.816244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.virt.hardware [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 20:12:41.825579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:41.826055 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:41.826488 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:41.827254 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:41.827708 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:41.828130 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:41.846032 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Getting quotas for project 21718c5f45b74854bd0a487939a0bd23. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 20:12:41.850953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.quota [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Getting quotas for user 7b585708ea6446e398c45196e9a992ac and project 21718c5f45b74854bd0a487939a0bd23. Resources: {'ram', 'cores', 'instances'} {{(pid=121186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 20:12:41.907096 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Going to run 1 instances... {{(pid=121186) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 20:12:41.909309 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9a6fa48e-1160-46a8-b2fc-792caa37c1df',volume_size=None,volume_type=None)] {{(pid=121186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 20:12:42.104056 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 43966. Aug 31 20:12:42.209282 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cfecf54f-9d0b-4d02-b483-1c248ff07904 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.115045 Aug 31 20:12:42.210136 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1113/2217] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 31 20:12:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 20:12:42.218736 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=4 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:42.219826 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:42.226331 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ae6f90bc-2f81-4ca4-a2c8-a7e6ce17b2a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:42.228486 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ae6f90bc-2f81-4ca4-a2c8-a7e6ce17b2a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:42.242558 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] [966a511b-72de-4381-9d8a-e99fd46e459d] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 43972. Aug 31 20:12:42.347228 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ae6f90bc-2f81-4ca4-a2c8-a7e6ce17b2a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:42.355614 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ae6f90bc-2f81-4ca4-a2c8-a7e6ce17b2a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1089 microversion: 2.1 time: 0.138458 Aug 31 20:12:42.356124 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1105/2218] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:42 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1089 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:43.378187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:43.378809 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:43.387227 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:43.387722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:43.388165 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:43.388864 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:43.389320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:43.389751 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:43.452468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:43.460203 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-e704fd96-80ec-445f-91c0-d22f280a4b1e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1139 microversion: 2.1 time: 0.086281 Aug 31 20:12:43.460830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1114/2219] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:43 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:44.481724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:44.482653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:44.491069 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:44.493756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:44.493756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:44.493756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:44.493756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:44.494087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:44.573663 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:44.579028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-592f75bf-a432-4e16-8dcd-b6a5c34c5ca1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1205 microversion: 2.1 time: 0.101453 Aug 31 20:12:44.579603 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1106/2220] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:44 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1205 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 20:12:45.605431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:45.605431 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:45.612054 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:45.612540 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:45.612976 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:45.613679 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:45.614135 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:45.614703 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:45.759089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:45.766845 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1067eea0-8221-4990-a4d7-04f54aaf49f0 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1272 microversion: 2.1 time: 0.166247 Aug 31 20:12:45.767477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1115/2221] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:45 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:46.181334 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-37c4faab-9112-453f-8115-115b2d430a6e req-902ff750-1300-4999-a3f4-eae54a87a24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:12:46.190680 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-37c4faab-9112-453f-8115-115b2d430a6e req-902ff750-1300-4999-a3f4-eae54a87a24a service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:46.191272 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-37c4faab-9112-453f-8115-115b2d430a6e req-902ff750-1300-4999-a3f4-eae54a87a24a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:46.193324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-37c4faab-9112-453f-8115-115b2d430a6e req-902ff750-1300-4999-a3f4-eae54a87a24a service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:46.204015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-37c4faab-9112-453f-8115-115b2d430a6e req-902ff750-1300-4999-a3f4-eae54a87a24a service nova] Creating event network-changed:b50525b4-b2a0-4c98-97f6-458b450e3d6b for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c on hv-cinder-85220 Aug 31 20:12:46.209980 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-37c4faab-9112-453f-8115-115b2d430a6e req-902ff750-1300-4999-a3f4-eae54a87a24a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094090 Aug 31 20:12:46.210568 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1107/2222] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:12:46.789796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:46.790308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:46.797061 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:46.797542 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:46.797975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:46.799021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:46.799481 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:46.799905 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:46.929956 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:46.937609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-a259c98f-3399-42b0-a5dd-f3aebf2d83a1 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.152517 Aug 31 20:12:46.938489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1116/2223] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:46 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:47.961052 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:47.961721 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:47.967913 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:47.968399 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:47.968843 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:47.969543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:47.970000 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:47.970433 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:48.190569 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:48.198694 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-52136c32-8756-4cb5-885a-2a2f2f18fce6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.243286 Aug 31 20:12:48.199301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1108/2224] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:47 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:49.219888 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:49.220503 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:49.227796 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:49.228274 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:49.228740 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:49.229438 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:49.229885 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:49.230308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:49.363832 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:49.372189 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-d36b693e-5291-497f-9590-e970e8233c97 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.156368 Aug 31 20:12:49.372765 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1117/2225] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:49 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:50.394097 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:50.394719 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:50.401977 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:50.402470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:50.402938 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:50.403642 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:50.404100 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:50.404529 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:50.537894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:50.546002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-1f020255-a5a1-4da3-88a9-eb96579d16a2 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.155897 Aug 31 20:12:50.548909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1109/2226] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:50 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:51.567001 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:51.567716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:51.574359 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:51.574841 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:51.575320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:51.576017 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:51.576477 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:51.576910 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:51.705941 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:51.714491 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-0a0253f1-9198-442b-b12a-76bc86e56105 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.151474 Aug 31 20:12:51.715101 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1118/2227] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:51 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:52.735489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:52.736112 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:52.738909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell0:SELECT=2 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:52.743825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:52.749675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:52.749675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:52.749675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:52.749675 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:52.750020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:52.880173 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:52.887923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-7bd04d9f-8af4-4ad2-9ca6-37061a359185 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.156374 Aug 31 20:12:52.888485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1110/2228] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:52 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:53.909509 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:53.910117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:53.911940 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:53.912731 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell0:SELECT=6 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:12:53.918087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:53.918563 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:53.919024 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:53.919717 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:53.920172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:53.920597 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:54.056844 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:54.064524 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-15f357b6-e597-411d-8bda-b1c17d84694f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.158859 Aug 31 20:12:54.065089 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1119/2229] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:53 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:55.086079 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:55.086692 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:55.093140 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:55.093562 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:55.094002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:55.094698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:55.095181 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:55.095612 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:55.225592 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:55.233239 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5c1b9547-52b5-45d5-a2fa-8687cb884473 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.151232 Aug 31 20:12:55.233795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1111/2230] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:55 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:56.254501 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:56.256149 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:56.262167 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:56.262658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:56.263151 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:56.263856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:56.264315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:56.264746 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:56.401650 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:56.409358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-973e954b-ad86-4eaa-bc34-0a757b6dcae4 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.158733 Aug 31 20:12:56.409931 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1120/2231] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:56 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:57.431305 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:57.431921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:57.438653 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:57.439161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:57.439639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:57.440327 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:57.440777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:57.441199 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:57.576188 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:57.584907 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-be1c77a7-78e7-48d8-91f2-6c39e5245c19 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.158244 Aug 31 20:12:57.585479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1112/2232] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:57 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:58.609880 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:58.611074 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:58.619793 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:58.620320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:58.620764 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:58.621470 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:58.621932 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:58.622363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:58.731623 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-56583304-b6e8-4dc5-9d52-39d1a2ec9492 req-dfcc7705-0fee-40e7-9ee0-9b3070b9747e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "name": "network-vif-plugged", "status": "completed", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:12:58.742369 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-56583304-b6e8-4dc5-9d52-39d1a2ec9492 req-dfcc7705-0fee-40e7-9ee0-9b3070b9747e service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:58.742864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-56583304-b6e8-4dc5-9d52-39d1a2ec9492 req-dfcc7705-0fee-40e7-9ee0-9b3070b9747e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:58.743328 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-56583304-b6e8-4dc5-9d52-39d1a2ec9492 req-dfcc7705-0fee-40e7-9ee0-9b3070b9747e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:58.756601 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-56583304-b6e8-4dc5-9d52-39d1a2ec9492 req-dfcc7705-0fee-40e7-9ee0-9b3070b9747e service nova] Creating event network-vif-plugged:b50525b4-b2a0-4c98-97f6-458b450e3d6b for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c on hv-cinder-85220 Aug 31 20:12:58.758698 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:58.762489 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-56583304-b6e8-4dc5-9d52-39d1a2ec9492 req-dfcc7705-0fee-40e7-9ee0-9b3070b9747e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094479 Aug 31 20:12:58.763136 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1113/2233] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:12:58.767340 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7cb1a791-0ad3-4e36-9f73-2d7b3bf36173 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.164855 Aug 31 20:12:58.767991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1121/2234] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:58 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:12:59.789662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:12:59.790372 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:12:59.796543 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:59.797034 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:59.797479 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:59.798179 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:12:59.798921 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:12:59.799359 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:12:59.930161 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:12:59.937903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-fd1a6f47-067c-47bb-a96a-248efb42e685 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.153179 Aug 31 20:12:59.938470 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1114/2235] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:12:59 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:13:00.959449 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:13:00.960066 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:13:00.966681 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:00.967249 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:00.967739 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:00.968512 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:00.968975 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:00.969407 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:01.104863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:13:01.113099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-f5782849-b3f7-4f7f-a74a-e258b8dd4a70 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1260 microversion: 2.1 time: 0.157678 Aug 31 20:13:01.113680 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1122/2236] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:13:00 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:13:02.134087 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:13:02.134699 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:13:02.141190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:02.141676 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:02.142119 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:02.145959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:02.145959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:02.145959 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:02.282422 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:13:02.290448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-281d92f1-0c78-4ddb-8098-690a8599c610 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1444 microversion: 2.1 time: 0.160812 Aug 31 20:13:02.291059 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1115/2237] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:13:02 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:13:02.310957 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:13:02.311573 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:13:02.319090 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:02.319555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:02.319992 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:02.320715 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:02.321177 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:02.321607 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:02.452805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:13:02.461006 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-30d8ba33-2850-485e-bc5d-46c5e449675e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1444 microversion: 2.1 time: 0.153983 Aug 31 20:13:02.461569 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1123/2238] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:13:02 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:13:04.763789 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-3baece15-cdea-4cd9-a253-32476398d6c2 req-fc50835d-c989-4197-b36f-f6d32fa70715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:13:04.773878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3baece15-cdea-4cd9-a253-32476398d6c2 req-fc50835d-c989-4197-b36f-f6d32fa70715 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:04.774363 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3baece15-cdea-4cd9-a253-32476398d6c2 req-fc50835d-c989-4197-b36f-f6d32fa70715 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:04.774795 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-3baece15-cdea-4cd9-a253-32476398d6c2 req-fc50835d-c989-4197-b36f-f6d32fa70715 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:04.785611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-3baece15-cdea-4cd9-a253-32476398d6c2 req-fc50835d-c989-4197-b36f-f6d32fa70715 service nova] Creating event network-changed:b50525b4-b2a0-4c98-97f6-458b450e3d6b for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c on hv-cinder-85220 Aug 31 20:13:04.790679 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-3baece15-cdea-4cd9-a253-32476398d6c2 req-fc50835d-c989-4197-b36f-f6d32fa70715 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088239 Aug 31 20:13:04.791324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1116/2239] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:13:31.880341 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:13:31.880863 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:13:31.882830 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:13:31.883518 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=62 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:13:31.888181 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:31.888676 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:31.889117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:31.889812 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:31.890273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:31.890733 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:31.903973 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: DELETE /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 HTTP/1.1 Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 20:13:31.905668 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.906890 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '7b9325f8-6461-4408-8b4b-5dbdbbd91cb7'} Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:13:31.907553 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.908720 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.910276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:13:31.910276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-4566ad8d-5997-4236-b7ad-b4017ff5bf92 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 404 len: 111 microversion: 2.1 time: 0.030765 Aug 31 20:13:31.910276 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1124/2240] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 20:13:31 2022] DELETE /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:13:31.914018 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=26 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:13:31.914836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=54 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:13:31.919002 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:13:31.919713 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:13:31.926567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:31.927701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:31.927701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:31.928461 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:13:31.928777 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:13:31.929214 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:13:31.942613 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 HTTP/1.1 Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 20:13:31.944288 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.945884 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '7b9325f8-6461-4408-8b4b-5dbdbbd91cb7'} Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:13:31.946714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. Aug 31 20:13:31.948015 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:13:31.949141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:13:31.949141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ab38217e-0704-4cc4-881c-1c3669a2f249 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7" status: 404 len: 111 microversion: 2.1 time: 0.033360 Aug 31 20:13:31.949141 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1117/2241] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:13:31 2022] GET /compute/v2.1/servers/7b9325f8-6461-4408-8b4b-5dbdbbd91cb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:15:18.756510 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:15:18.757086 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:18.765267 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:18.765760 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:18.766202 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:18.766924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:18.767402 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:18.767970 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:18.792656 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.objects.instance [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lazy-loading 'flavor' on Instance uuid 3d681a8b-9747-4f32-b6f6-dc242336e23c {{(pid=121186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 20:15:19.042334 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-32c52e39-39e1-4349-ad6c-6ccdd68f2eef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "POST /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c/action" status: 202 len: 0 microversion: 2.1 time: 0.291252 Aug 31 20:15:19.042843 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1125/2242] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 20:15:18 2022] POST /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 20:15:19.050067 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:15:19.050582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c (ip 10.222.0.59) !!! Aug 31 20:15:19.051657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:15:19.051657 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c (ip 10.222.0.59) !!! Aug 31 20:15:19.052824 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 20:15:19.052955 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:15:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c (ip 10.222.0.59) !!! Aug 31 20:15:19.057918 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:19.058530 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:19.071723 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:19.072210 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:19.072648 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:19.073341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:19.073799 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:19.074225 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:19.211311 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:19.219280 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-d1fee791-a9b7-44c1-8531-3f8aab2f4d4c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.171804 Aug 31 20:15:19.219862 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1118/2243] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:19 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:20.242263 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:20.242898 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:20.249603 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:20.250180 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:20.250615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:20.251332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:20.251783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:20.252204 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:20.388461 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:20.396953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2477c88a-4aef-495a-bf15-4d973dea0144 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.158939 Aug 31 20:15:20.397523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1126/2244] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:20 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:21.417397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:21.417985 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:21.425245 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:21.425756 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:21.426197 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:21.426903 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:21.427374 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:21.427801 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:21.555403 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:21.563085 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e45a6450-386b-46a5-9fe1-779fb6634996 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.149519 Aug 31 20:15:21.563649 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1119/2245] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:21 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:22.585219 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:22.585827 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:22.592234 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:22.592716 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:22.593147 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:22.593828 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:22.594287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:22.594709 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:22.722497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:22.730929 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-28cb9c83-b4cd-40d9-8695-d215c6e212e3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.149584 Aug 31 20:15:22.731497 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1127/2246] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:22 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:23.751666 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:23.752273 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:23.759291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:23.759772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:23.760207 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:23.760890 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:23.761343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:23.761764 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:23.893347 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:23.900942 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-180b7a19-86f4-4e50-afa9-8bb218ae4f0e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.153096 Aug 31 20:15:23.901506 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1120/2247] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:23 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:24.922046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:24.922661 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:24.929996 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:24.930480 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:24.930951 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:24.931655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:24.932118 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:24.932551 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:25.063037 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:25.070738 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c92f1868-2519-4e8d-b512-20559d42af10 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.152828 Aug 31 20:15:25.071338 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1128/2248] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:24 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:26.092129 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:26.092754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:26.099349 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:26.099841 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:26.100291 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:26.100988 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:26.101455 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:26.101891 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:26.232169 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:26.240068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-5024c827-1eaa-4d04-ab89-a033578fe41c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.151823 Aug 31 20:15:26.240638 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1121/2249] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:26 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:27.260310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:27.260933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:27.267320 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:27.267805 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:27.268318 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:27.269019 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:27.269984 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:27.270417 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:27.400083 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:27.407836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-cdbede74-efd3-4665-af41-7e815d7b5cec tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.151339 Aug 31 20:15:27.408394 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1129/2250] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:27 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:28.430517 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:28.431166 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:28.437524 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:28.438007 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:28.438445 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:28.439163 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:28.439621 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:28.440045 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:28.567528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:28.575257 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e1f42bf2-6f5c-4551-8320-44d35af44ee3 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.148549 Aug 31 20:15:28.575825 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1122/2251] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:28 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:29.596556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:29.597171 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:29.603865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:29.604342 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:29.604784 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:29.605474 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:29.605920 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:29.606346 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:29.737505 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:29.746273 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-955eec99-7650-476d-a536-2c94433c9022 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.153565 Aug 31 20:15:29.746851 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1130/2252] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:29 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:30.768010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:30.768549 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:30.776025 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:30.776511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:30.776961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:30.777654 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:30.778114 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:30.778546 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:30.913765 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:30.922159 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-43bfd555-55cc-4fa9-b494-61a3302ebf85 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.157717 Aug 31 20:15:30.922794 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1123/2253] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:30 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:31.944626 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:31.945197 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:31.951601 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:31.952084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:31.952523 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:31.953226 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:31.953685 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:31.954117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:32.091802 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:32.099819 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-921861cf-60c7-4bbc-9366-368106e8c278 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.159672 Aug 31 20:15:32.100391 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1131/2254] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:31 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:33.121865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:33.123190 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:33.129617 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:33.131990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:33.131990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:33.131990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:33.131990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:33.132379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:33.268464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:33.277265 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-dd6b5c90-26f3-47f8-ac87-84bc242498fe tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1569 microversion: 2.1 time: 0.159308 Aug 31 20:15:33.277853 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1124/2255] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:33 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:33.298208 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:15:33.298813 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:33.305404 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:33.306093 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:33.306537 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:33.307264 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:33.307723 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:33.308154 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:33.351186 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121186) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 20:15:33.674722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-57fad101-7c07-42ea-bc23-2ecc14091b5a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "POST /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c/action" status: 202 len: 0 microversion: 2.1 time: 0.380574 Aug 31 20:15:33.675324 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1132/2256] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 31 20:15:33 2022] POST /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 20:15:33.683385 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:33.684405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:33.690337 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:33.690832 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:33.691306 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:33.692010 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:33.692999 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:33.693633 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:33.832138 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:33.841464 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-510d6496-ca7b-439d-8313-fd3b6fa7c297 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1517 microversion: 2.1 time: 0.161927 Aug 31 20:15:33.842914 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1125/2257] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:33 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:34.862369 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:34.863034 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:34.869127 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:34.869615 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:34.870084 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:34.870814 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:34.871305 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:34.871847 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:35.006995 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:35.014958 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-57de9b98-d615-4ca8-9815-37c31644c4ef tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1519 microversion: 2.1 time: 0.156965 Aug 31 20:15:35.015531 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1133/2258] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:34 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 20:15:35.336878 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-6587345f-50cc-4954-90d7-17dc9f554beb req-d2e409c5-33e2-45ec-9d3c-1cd08432c50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "name": "network-vif-unplugged", "status": "completed", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:15:35.347049 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-6587345f-50cc-4954-90d7-17dc9f554beb req-d2e409c5-33e2-45ec-9d3c-1cd08432c50e service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:35.347534 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-6587345f-50cc-4954-90d7-17dc9f554beb req-d2e409c5-33e2-45ec-9d3c-1cd08432c50e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:35.347973 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-6587345f-50cc-4954-90d7-17dc9f554beb req-d2e409c5-33e2-45ec-9d3c-1cd08432c50e service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:35.359573 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.compute.server_external_events [req-6587345f-50cc-4954-90d7-17dc9f554beb req-d2e409c5-33e2-45ec-9d3c-1cd08432c50e service nova] Unable to find a host for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c. Dropping event network-vif-unplugged {{(pid=121187) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 20:15:35.360448 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-6587345f-50cc-4954-90d7-17dc9f554beb req-d2e409c5-33e2-45ec-9d3c-1cd08432c50e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028618 Aug 31 20:15:35.361027 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1126/2259] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 20:15:36.036728 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:36.037872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:36.044332 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:36.044862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:36.045310 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:36.045991 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:36.046688 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:36.047146 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:36.180714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:36.188564 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-6e0e0118-d1d1-4750-99ef-eb9a0015c261 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1519 microversion: 2.1 time: 0.155649 Aug 31 20:15:36.189139 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1134/2260] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:36 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:37.211523 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:37.212142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:37.218961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:37.219389 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:37.219822 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:37.220531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:37.221005 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:37.221430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:37.476816 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:37.484482 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-a02fa5b5-92cf-4824-8582-24599c92572c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.277045 Aug 31 20:15:37.485054 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1127/2261] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:37 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:38.505581 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:38.506277 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:38.513079 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:38.513630 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:38.514087 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:38.514865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:38.515358 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:38.515869 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:38.649773 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:38.657426 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-2b218927-b179-41eb-bbb3-0aeb66c321a9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.155738 Aug 31 20:15:38.657989 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1135/2262] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:38 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 20:15:39.679480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:39.680116 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:39.687286 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:39.687768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:39.688485 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:39.689270 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:39.689724 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:39.690152 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:39.822030 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:39.829915 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-eb203cde-5c2f-478b-a0ee-b8c99a52679c tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.154703 Aug 31 20:15:39.830511 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1128/2263] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:39 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:40.852070 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:40.852655 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:40.859373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:40.859861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:40.860300 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:40.861000 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:40.861457 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:40.861882 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:40.992687 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:41.000704 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-8d737a34-c258-4194-aa73-3928dd35e277 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.152890 Aug 31 20:15:41.001583 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1136/2264] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:40 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:42.021803 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:42.022686 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:42.029584 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:42.030081 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:42.030531 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:42.031264 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:42.031728 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:42.032160 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:42.171158 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:42.175466 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-71269675-61da-47d7-8533-314895da5a22 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.157526 Aug 31 20:15:42.176048 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1129/2265] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:42 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:43.197172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:43.197783 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:43.205351 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:43.205840 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:43.206287 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:43.207045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:43.207511 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:43.207953 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:43.348701 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:43.357960 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-7209ce40-0175-4b16-a49d-e466cf54c19d tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.165331 Aug 31 20:15:43.358555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1137/2266] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:43 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:15:43.533068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-6386a538-678a-405a-bdc1-e04b747fe046 req-bd6ea368-bb3d-428c-9ed1-c44124ff1ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "name": "network-vif-plugged", "status": "completed", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:15:43.543033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-6386a538-678a-405a-bdc1-e04b747fe046 req-bd6ea368-bb3d-428c-9ed1-c44124ff1ca1 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:43.546708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-6386a538-678a-405a-bdc1-e04b747fe046 req-bd6ea368-bb3d-428c-9ed1-c44124ff1ca1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:43.546708 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-6386a538-678a-405a-bdc1-e04b747fe046 req-bd6ea368-bb3d-428c-9ed1-c44124ff1ca1 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:43.555519 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-6386a538-678a-405a-bdc1-e04b747fe046 req-bd6ea368-bb3d-428c-9ed1-c44124ff1ca1 service nova] Creating event network-vif-plugged:b50525b4-b2a0-4c98-97f6-458b450e3d6b for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c on hv-cinder-85220 Aug 31 20:15:43.562189 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-6386a538-678a-405a-bdc1-e04b747fe046 req-bd6ea368-bb3d-428c-9ed1-c44124ff1ca1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032984 Aug 31 20:15:43.562775 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1130/2267] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:15:44.380192 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:44.380862 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:44.388046 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:44.388562 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:44.389005 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:44.389729 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:44.390191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:44.390621 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:44.394669 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:15:44.532857 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:44.540962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1c8ff0e0-6b7e-40c5-bb43-4de1b9de6bab tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1575 microversion: 2.1 time: 0.164591 Aug 31 20:15:44.541658 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1138/2268] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:44 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 20:15:45.566755 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:15:45.567405 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:15:45.574068 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:45.574556 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:45.575033 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:45.575735 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:15:45.576201 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:15:45.576635 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:15:45.704778 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:15:45.713438 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-aa6ac0c2-c98a-4e17-92c9-452f8e03c8c9 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1562 microversion: 2.1 time: 0.151536 Aug 31 20:15:45.714022 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1131/2269] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:15:45 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:17:23.006969 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:17:23.008050 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=4 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:17:23.008494 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=30 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:17:23.008901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:17:23.008901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c (ip 10.222.0.59) !!! Aug 31 20:17:23.009342 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=78 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:17:23.014397 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [req-dd4cff91-a859-458a-8765-b6e2c03913b9 req-213b06d3-10da-4156-a6f6-a20f320dcca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:17:23.022014 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:23.022967 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:17:23.025990 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-dd4cff91-a859-458a-8765-b6e2c03913b9 req-213b06d3-10da-4156-a6f6-a20f320dcca9 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:23.026754 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-dd4cff91-a859-458a-8765-b6e2c03913b9 req-213b06d3-10da-4156-a6f6-a20f320dcca9 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:23.027324 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [req-dd4cff91-a859-458a-8765-b6e2c03913b9 req-213b06d3-10da-4156-a6f6-a20f320dcca9 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:23.031980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:23.031980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:23.031980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:23.031980 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:23.032579 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:23.032714 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:23.052701 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.compute.server_external_events [req-dd4cff91-a859-458a-8765-b6e2c03913b9 req-213b06d3-10da-4156-a6f6-a20f320dcca9 service nova] Creating event network-changed:b50525b4-b2a0-4c98-97f6-458b450e3d6b for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c on hv-cinder-85220 Aug 31 20:17:23.058962 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [req-dd4cff91-a859-458a-8765-b6e2c03913b9 req-213b06d3-10da-4156-a6f6-a20f320dcca9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052329 Aug 31 20:17:23.063872 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Going to try to terminate instance {{(pid=121186) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 20:17:23.064528 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1132/2270] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:17:23.352316 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-10ebd4c2-69af-4089-985d-9225e8989b47 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "DELETE /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 204 len: 0 microversion: 2.1 time: 0.347336 Aug 31 20:17:23.353609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1139/2271] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 20:17:23 2022] DELETE /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 20:17:23.363698 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:23.369308 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:17:23.371343 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:23.371837 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:23.372275 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:23.372984 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:23.373567 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:23.373983 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:23.524643 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:17:23.532893 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-609409fe-7938-4643-b959-ee76307abf4f tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.174646 Aug 31 20:17:23.533768 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1133/2272] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:17:23 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 20:17:24.557649 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:24.558270 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:17:24.565187 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:24.565675 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:24.566117 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:24.567329 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:24.567446 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:24.567962 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:24.715363 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:17:24.727099 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-3a19a306-888e-4656-b0a8-00c006101f9b tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1568 microversion: 2.1 time: 0.173955 Aug 31 20:17:24.727696 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1140/2273] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:17:24 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:17:25.750017 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:25.751449 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:17:25.760480 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:25.761183 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:25.761900 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:25.762937 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:25.763618 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:25.771865 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:25.826856 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [req-14d70c9c-3b4f-4a3a-bcf1-26613f1ea4b0 req-46930f10-c79d-488f-8268-79f636b43369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d681a8b-9747-4f32-b6f6-dc242336e23c", "name": "network-vif-deleted", "tag": "b50525b4-b2a0-4c98-97f6-458b450e3d6b"}]} {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 20:17:25.832232 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-14d70c9c-3b4f-4a3a-bcf1-26613f1ea4b0 req-46930f10-c79d-488f-8268-79f636b43369 service nova] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:25.832721 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-14d70c9c-3b4f-4a3a-bcf1-26613f1ea4b0 req-46930f10-c79d-488f-8268-79f636b43369 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:25.833184 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [req-14d70c9c-3b4f-4a3a-bcf1-26613f1ea4b0 req-46930f10-c79d-488f-8268-79f636b43369 service nova] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:25.851766 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.compute.server_external_events [req-14d70c9c-3b4f-4a3a-bcf1-26613f1ea4b0 req-46930f10-c79d-488f-8268-79f636b43369 service nova] Creating event network-vif-deleted:b50525b4-b2a0-4c98-97f6-458b450e3d6b for instance 3d681a8b-9747-4f32-b6f6-dc242336e23c on hv-cinder-85220 Aug 31 20:17:25.857582 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.policy [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121187) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:17:25.857806 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [req-14d70c9c-3b4f-4a3a-bcf1-26613f1ea4b0 req-46930f10-c79d-488f-8268-79f636b43369 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041005 Aug 31 20:17:25.858489 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1141/2274] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 31 20:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 20:17:25.866902 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-ba6ba5c7-d613-4bb5-ba8b-ee4fd8f58dae tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1383 microversion: 2.1 time: 0.121192 Aug 31 20:17:25.867662 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1134/2275] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:17:25 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1383 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:17:26.888591 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:26.889288 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:17:26.897901 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:26.898406 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:26.898930 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:26.899881 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:26.900377 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:26.900933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:26.976609 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.policy [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b585708ea6446e398c45196e9a992ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21718c5f45b74854bd0a487939a0bd23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121186) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 20:17:26.982191 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-c2df0ed4-205b-4f10-b5ce-b81ab609fbe6 tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 200 len: 1220 microversion: 2.1 time: 0.097779 Aug 31 20:17:26.983021 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1142/2276] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:17:26 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 20:17:28.005084 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:28.005712 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] [instance: 3d681a8b-9747-4f32-b6f6-dc242336e23c] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:17:28.015597 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:28.023659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:28.023659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:28.023659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:17:28.023659 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:17:28.024714 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:17:28.033639 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] HTTP exception thrown: Instance 3d681a8b-9747-4f32-b6f6-dc242336e23c could not be found. Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Request method failure captured: Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c HTTP/1.1 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD8CYqwfkF4xXFYJY45WXIGF-bE18FAdHwaXYzblIDHLCNDI6b57CVqx-RpeLWPbnzdfD8aohYffUrkYWv8m79t4hoXOmtSk3lwAChtMLuaVB4zOnJQkcGueCyOLkAMHSglxLOpiRYQIifHVDdbdsE5DcvAACiwGeDUtI3ufkWrX7rY0 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: 21718c5f45b74854bd0a487939a0bd23 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-TestShelveInstance-1332863944 Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 20:17:28.036905 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21718c5f45b74854bd0a487939a0bd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/21718c5f45b74854bd0a487939a0bd23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/21718c5f45b74854bd0a487939a0bd23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_21718c5f45b74854bd0a487939a0bd23", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-TestShelveInstance-1332863944 Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: 21718c5f45b74854bd0a487939a0bd23 Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-TestShelveInstance-1332863944 Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-TestShelveInstance-1332863944-project Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 7b585708ea6446e398c45196e9a992ac Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-TestShelveInstance-1332863944-project Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 3d681a8b-9747-4f32-b6f6-dc242336e23c could not be found. Aug 31 20:17:28.038193 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '3d681a8b-9747-4f32-b6f6-dc242336e23c'} Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d681a8b-9747-4f32-b6f6-dc242336e23c could not be found. Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:17:28.038961 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d681a8b-9747-4f32-b6f6-dc242336e23c could not be found. Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d681a8b-9747-4f32-b6f6-dc242336e23c could not be found. Aug 31 20:17:28.040121 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:17:28.041251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Returning 404 to user: Instance 3d681a8b-9747-4f32-b6f6-dc242336e23c could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:17:28.041251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-2cbdff68-dd4c-48c8-b9de-f007b5b77f7a tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c" status: 404 len: 111 microversion: 2.1 time: 0.037768 Aug 31 20:17:28.041251 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1135/2277] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:17:27 2022] GET /compute/v2.1/servers/3d681a8b-9747-4f32-b6f6-dc242336e23c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:17:28.299132 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-5aaf0aa5-e1b2-4964-bf12-84c0885e033e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] Calling method '.version_select at 0x7ff6cb7f6940>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:17:28.404692 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-5aaf0aa5-e1b2-4964-bf12-84c0885e033e tempest-TestShelveInstance-1332863944 tempest-TestShelveInstance-1332863944-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1656850468" status: 202 len: 0 microversion: 2.1 time: 0.109997 Aug 31 20:17:28.405315 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1143/2278] 10.222.0.59 () {58 vars in 1254 bytes} [Wed Aug 31 20:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1656850468 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 20:19:31.442836 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_api:SELECT=8 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:19:31.443731 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG dbcounter [-] [121187] Writing DB stats nova_cell1:SELECT=16 {{(pid=121187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:19:31.444788 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:19:31.444939 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 20:19:31.445909 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:19:31.446020 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Wed Aug 31 20:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 20:19:31.451440 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:19:31.455244 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:19:31.461421 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.461917 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.462364 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.463135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.463894 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.464474 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.479864 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 HTTP/1.1 Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 20:19:31.481430 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.483070 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '84bc06b8-f021-4ee4-ace6-d6cc9a4ac438'} Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:19:31.483757 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.484923 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.486028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:19:31.486028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-165adb8f-ddae-4f6b-bcdf-8b54d6f0c1a3 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 404 len: 111 microversion: 2.1 time: 0.041902 Aug 31 20:19:31.486028 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1136/2279] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 20:19:31 2022] DELETE /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:19:31.491172 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 20:19:31.491722 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:19:31.492472 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG dbcounter [-] [121186] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 20:19:31.493548 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 20:19:31.493705 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Wed Aug 31 20:19:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 (ip 10.222.0.59) !!! Aug 31 20:19:31.501867 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:19:31.502496 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:19:31.512355 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.512846 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.513289 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.513998 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.514464 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.514924 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.528933 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 HTTP/1.1 Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 20:19:31.530556 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.532041 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '84bc06b8-f021-4ee4-ace6-d6cc9a4ac438'} Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:19:31.532879 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. Aug 31 20:19:31.533944 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.535142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:19:31.535142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-af33ede0-9d68-44a7-a7c4-c514eb9a7d07 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438" status: 404 len: 111 microversion: 2.1 time: 0.044347 Aug 31 20:19:31.535142 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1144/2280] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:19:31 2022] GET /compute/v2.1/servers/84bc06b8-f021-4ee4-ace6-d6cc9a4ac438 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:19:31.541373 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:19:31.542622 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:19:31.552341 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.556142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.556142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.556142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.556142 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.556749 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.570212 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: DELETE /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 HTTP/1.1 Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 20:19:31.571845 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.573301 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '9e12e83c-b998-423b-a10f-ca1d120457c5'} Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:19:31.574271 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.575462 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.576611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:19:31.576611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-866a16f2-bd46-46f7-a0c6-bc334925e9f4 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 404 len: 111 microversion: 2.1 time: 0.036176 Aug 31 20:19:31.576611 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1137/2281] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 20:19:31 2022] DELETE /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:19:31.582244 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:19:31.588541 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 9e12e83c-b998-423b-a10f-ca1d120457c5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:19:31.589725 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.590213 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.590657 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.591408 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:31.591873 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:31.592308 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:31.606835 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 HTTP/1.1 Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 20:19:31.608410 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.609697 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '9e12e83c-b998-423b-a10f-ca1d120457c5'} Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:19:31.610373 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. Aug 31 20:19:31.612447 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:31.613836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 9e12e83c-b998-423b-a10f-ca1d120457c5 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:19:31.613836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-1dfd8238-77f3-48e7-a2e6-728f0fad15ba tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5" status: 404 len: 111 microversion: 2.1 time: 0.031592 Aug 31 20:19:31.613836 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1145/2282] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:19:31 2022] GET /compute/v2.1/servers/9e12e83c-b998-423b-a10f-ca1d120457c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:19:32.898629 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:19:32.899135 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.compute.api [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121187) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:19:32.906289 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:32.906772 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:32.907238 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:32.907929 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:32.908379 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:32.908806 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG oslo_concurrency.lockutils [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:32.923011 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.wsgi [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: request: DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 HTTP/1.1 Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept: application/json Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Accept-Encoding: identity Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Connection: close Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Length: 0 Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Content-Type: application/json Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Host: 10.222.0.59 Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: Openstack-System-Scope: None Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: User-Agent: python-urllib3/1.26.12 Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Id: None Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Domain-Name: None Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Identity-Status: Confirmed Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Is-Admin-Project: True Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Id: default Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Domain-Name: Default Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Role: member,reader Aug 31 20:19:32.924554 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Roles: member,reader Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Id: default Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Domain-Name: Default Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: method: > Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: exception: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.925873 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: action_args: {'id': '952eb54c-5683-4fdf-ad61-7564b9dafbb5'} Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: {{(pid=121187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:19:32.926559 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.928093 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.929483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: DEBUG nova.api.openstack.wsgi [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. {{(pid=121187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:19:32.929483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: INFO nova.api.openstack.requestlog [None req-e517bcca-5d2b-4df1-acf7-323c65e82585 tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 404 len: 111 microversion: 2.1 time: 0.031176 Aug 31 20:19:32.929483 dv-cinder-852209-9-iscsi devstack@n-api.service[121187]: [pid: 121187|app: 0|req: 1138/2283] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 31 20:19:32 2022] DELETE /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 20:19:32.935040 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Calling method '>' {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 20:19:32.935986 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.compute.api [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] [instance: 952eb54c-5683-4fdf-ad61-7564b9dafbb5] Fetching instance by UUID {{(pid=121186) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 20:19:32.944949 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:32.945432 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:32.945865 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:32.946555 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Acquiring lock "3de6f35d-b6ae-4864-abed-e50e71414e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 20:19:32.947045 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 20:19:32.947468 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG oslo_concurrency.lockutils [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Lock "3de6f35d-b6ae-4864-abed-e50e71414e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 20:19:32.950859 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO oslo.messaging._drivers.impl_rabbit [-] [fe9d30fe-0129-4667-9ea3-31e4c1930524] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 45136. Aug 31 20:19:32.962199 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.wsgi [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] HTTP exception thrown: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Request method failure captured: Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: request: GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 HTTP/1.1 Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept: application/json Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Accept-Encoding: identity Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Connection: close Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Length: 0 Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Content-Type: application/json Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Host: 10.222.0.59 Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: Openstack-System-Scope: None Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: User-Agent: python-urllib3/1.26.12 Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Auth-Token: gAAAAABjD7dsMwVfKA12otN9ei_suVuQeO79cBgXqChkSWKuctD_f9K815AZc3QF7SAQmsAViPkwVg4BOPEbxJzsxeBw3L0RmOWOI91rO19ysT6jidq0_G7j056PD6B8FqFsxcEqrrRDSyNTjvJKSGHzNI1LMMpnFpTSWtrhrm0kvlttXyaMIWQ Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Id: None Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Domain-Name: None Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Identity-Status: Confirmed Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Is-Admin-Project: True Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Id: default Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Domain-Name: Default Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Role: member,reader Aug 31 20:19:32.964395 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Roles: member,reader Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dc120bdcb47d4b1b872e2132b8ee9f2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dc120bdcb47d4b1b872e2132b8ee9f2e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Id: dc120bdcb47d4b1b872e2132b8ee9f2e Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1119123755 Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Id: default Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Domain-Name: Default Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Id: 991f6d49ad014318bc9c2f5d57b9deb7 Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: X-User-Name: tempest-AttachVolumeNegativeTest-1119123755-project Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: method: > Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: exception: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.965861 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: action_args: {'id': '952eb54c-5683-4fdf-ad61-7564b9dafbb5'} Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: {{(pid=121186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 20:19:32.966606 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. Aug 31 20:19:32.968409 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: ERROR nova.api.openstack.wsgi Aug 31 20:19:32.969639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: DEBUG nova.api.openstack.wsgi [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] Returning 404 to user: Instance 952eb54c-5683-4fdf-ad61-7564b9dafbb5 could not be found. {{(pid=121186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 20:19:32.969639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: INFO nova.api.openstack.requestlog [None req-b56a63af-56c6-4747-819d-45ef7fa2c91e tempest-AttachVolumeNegativeTest-1119123755 tempest-AttachVolumeNegativeTest-1119123755-project] 10.222.0.59 "GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5" status: 404 len: 111 microversion: 2.1 time: 0.035419 Aug 31 20:19:32.969639 dv-cinder-852209-9-iscsi devstack@n-api.service[121186]: [pid: 121186|app: 0|req: 1146/2284] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 31 20:19:32 2022] GET /compute/v2.1/servers/952eb54c-5683-4fdf-ad61-7564b9dafbb5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)